-- Logs begin at Thu 2022-07-21 21:43:40 UTC, end at Thu 2022-07-21 22:53:52 UTC. -- Jul 21 22:23:50.351614 dv-cinder-850698-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 22:23:50.361813 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 22:23:50 2022] *** Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: nodename: dv-cinder-850698-1-iscsi Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: machine: x86_64 Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: clock source: unix Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: pcre jit disabled Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: detected number of CPU cores: 4 Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: current working directory: / Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: detected binary path: /usr/bin/uwsgi-core Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: your processes number limit is 47680 Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: your memory page size is 4096 bytes Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: detected max file descriptor number: 2048 Jul 21 22:23:50.363858 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: lock engine: pthread robust mutexes Jul 21 22:23:50.365359 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: thunder lock: enabled Jul 21 22:23:50.365359 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 22:23:50.365359 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 22:23:50.410788 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: Python main interpreter initialized at 0x5568912a29c0 Jul 21 22:23:50.410788 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: python threads support enabled Jul 21 22:23:50.410788 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: your server socket listen backlog is limited to 100 connections Jul 21 22:23:50.410788 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: your mercy for graceful operations on workers is 90 seconds Jul 21 22:23:50.411284 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 22:23:50.411284 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: *** Operational MODE: preforking *** Jul 21 22:23:50.411599 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: *** uWSGI is running in multiple interpreter mode *** Jul 21 22:23:50.411599 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: spawned uWSGI master process (pid: 103285) Jul 21 22:23:50.411835 dv-cinder-850698-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 22:23:50.415098 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: spawned uWSGI worker 1 (pid: 103286, cores: 1) Jul 21 22:23:50.415098 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: spawned uWSGI worker 2 (pid: 103287, cores: 1) Jul 21 22:23:50.415098 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 22:23:51.124936 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:23:51.142975 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:23:52.310492 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:23:52.310492 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: from cryptography.utils import int_from_bytes Jul 21 22:23:52.311324 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:23:52.311324 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: from cryptography.utils import int_from_bytes Jul 21 22:23:52.445332 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:23:52.445332 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: from cryptography.utils import int_from_bytes Jul 21 22:23:52.446035 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:23:52.446035 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: from cryptography.utils import int_from_bytes Jul 21 22:23:54.972692 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:23:54.973458 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:23:54.973458 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:23:54.973769 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:23:54.974038 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:23:54.974410 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.974743 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.975088 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.975414 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.975752 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.976192 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.976551 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.976843 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.977264 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.977441 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.977737 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.978087 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850698-1-iscsi {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.978394 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.978703 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.979101 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.979437 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.979741 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.980069 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.980375 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.980875 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.981320 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.981711 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.982014 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.983040 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.983551 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.984116 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.984549 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.984882 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.985236 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.985540 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.985948 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850698-1-iscsi {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.986272 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.986843 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.986962 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.987336 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.987651 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.987968 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.988292 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.988620 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.988926 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.989259 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.989655 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.989987 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.990305 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.990610 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.990926 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.991261 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.991585 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.991897 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.992200 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.992454 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.992764 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.993089 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.993410 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.993735 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.993990 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.994241 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.994561 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.994885 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.995222 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.995536 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.995842 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.996154 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.996463 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.996769 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.997078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.997385 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.997707 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.998704 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.999333 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:54.999768 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.000105 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.000524 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.000777 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.001089 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.001442 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.001765 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.002077 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.002401 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.002724 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.003034 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.003373 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.003682 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.004023 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.004358 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.004665 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.004920 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.005224 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.005529 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.005853 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.006160 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.006468 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.006777 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.007103 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.007412 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.007720 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.008029 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.008338 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.008643 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.008954 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.009262 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.009567 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.009873 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.010195 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.010517 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.010827 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.011166 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.011553 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.011862 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.012186 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.012496 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.012803 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.013127 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.014109 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.014424 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.014795 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.015134 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.015450 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.015774 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.016082 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.016390 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.016714 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.017019 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.017330 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.017636 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.017944 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.018252 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.018561 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.018869 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.019206 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.019511 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.019831 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.020156 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.020473 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.020780 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.021086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.021473 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.021819 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.022168 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.022515 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.022844 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.023180 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.023517 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.023838 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.024160 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.024472 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.024869 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.025184 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.025501 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.025862 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.026206 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.026529 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.026861 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.027205 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.027526 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.027845 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.028157 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.028478 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.028816 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.029277 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.029657 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:23:55.030502 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.030703 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:23:55.030865 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.031010 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:23:55.031210 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.031210 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.031486 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:23:55.031662 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.031825 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:23:55.031984 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.032320 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.032469 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.032630 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.032796 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.032942 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.033124 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.033384 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.033549 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.033549 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.033900 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.034048 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.034194 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.034361 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.034519 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.034678 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.034995 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.035180 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.035325 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.035497 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.035656 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.035807 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.035939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.036090 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.036222 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850698-1-iscsi {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.036348 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.036479 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.036610 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.036723 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.036841 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.036970 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.037164 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.037321 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.037321 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.037620 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.037620 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.037910 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.038069 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.038069 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.038354 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.038510 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.038510 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.038848 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.039000 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.039220 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.039220 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.039601 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.039765 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.039922 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.040065 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.040210 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.040482 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.040675 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.040828 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.041092 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.041254 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.041400 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.041705 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.041866 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.042022 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.042316 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.042492 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.042652 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.042992 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.043189 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.043452 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.043605 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.043770 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.044005 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.044242 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.044397 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.044625 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.045378 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.045577 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.045941 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850698-1-iscsi {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.046127 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.046538 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.046707 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.046982 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.047163 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.047311 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.047606 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.047781 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.047938 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.048261 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.048415 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.048573 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.048916 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.049088 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.049243 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.049454 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.049662 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.049857 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.050149 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.050319 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.050596 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.050835 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.051103 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.051271 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.051539 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.051693 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.051849 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.052104 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.052256 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.052465 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.052757 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.052911 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.053140 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.053284 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.053447 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.053758 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.053925 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.054080 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.054377 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.054526 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.054668 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.054911 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.055190 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.055353 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.055491 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.055617 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.056041 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.056317 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.056522 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.056666 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.056818 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.057016 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.057342 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.057507 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.057654 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.057958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.058115 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.058274 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.058517 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.058682 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.058897 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.059145 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.059280 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.059569 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.059845 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.060069 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.060229 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.060421 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.061169 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.061439 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.061603 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.061924 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.062129 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.062375 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.062568 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.062719 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.063000 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.063171 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.063351 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.063651 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.063803 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.064021 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.064179 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.064323 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.064635 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.064791 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.064950 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.065258 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.065430 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.065574 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.065943 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.066098 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.066230 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.066487 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.066648 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.066788 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.067084 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.067258 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.067440 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.067735 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.067902 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.068049 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.068296 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.068460 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.068671 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.068968 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.069133 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.069350 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.069605 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.069760 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.069938 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.070187 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.070339 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.070550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.070836 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.071001 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.071197 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.071512 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.071663 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.071897 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.072051 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.072210 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.072520 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.072672 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.072829 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.073107 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.073260 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.073433 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.073656 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.073808 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.074042 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.074198 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.074427 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.074697 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.074862 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.075023 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.075328 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.075480 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.075866 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.076326 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.077115 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.077274 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.077419 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.077564 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.077707 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.077707 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.077994 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.078138 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.078138 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.078399 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.078551 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.078743 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.078898 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.079087 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.079275 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.079481 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.079678 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.079835 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.080028 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.080330 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.080498 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.080642 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.080876 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.081043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.081251 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.081397 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.081551 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.081864 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.082032 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.082196 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.082401 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.082564 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.082782 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.082938 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.083157 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.083422 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.083574 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.083820 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.083974 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.084117 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.084398 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.084552 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.084735 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.084930 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.085081 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.085362 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.085530 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.085674 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.085909 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.086061 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.086389 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.086539 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.086704 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.086850 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.087017 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.087473 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.087644 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.087816 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.088125 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.088279 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.088499 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.088707 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.088859 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.089093 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.089252 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.089427 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.089762 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.089915 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.090104 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.090366 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.090651 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.090810 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.091009 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.091246 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.091408 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.091942 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.092249 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.092249 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.092524 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.092681 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.092890 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.093052 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.093320 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.093586 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.093786 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.093940 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.094140 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.094305 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.094524 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.094847 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.095000 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.095248 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.095424 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.095562 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.095783 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.096060 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.096231 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.096556 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.096702 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.096855 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.097002 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.097282 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.097435 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.097624 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.097933 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.098098 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.098271 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.098569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.098796 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.099013 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.099195 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.099355 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.099560 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.099706 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.099887 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.100195 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.100360 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.100573 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.100721 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.100867 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.101088 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.101364 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.101533 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.101761 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.102003 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.102208 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.102357 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.102682 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.102896 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.103043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.103273 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.103448 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.103607 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.103864 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.104095 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.104327 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.104534 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.104739 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.104954 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.105168 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.105396 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.105396 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.105795 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.106016 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.106237 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.106237 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.106721 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.106868 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.106868 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.107143 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.107821 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.108069 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.108308 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.108726 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:55.108882 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.109112 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.109260 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.109422 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.109727 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.109929 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.110078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.110360 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.110508 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.110650 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.110952 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.111133 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.111279 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.111550 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.111724 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.111883 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.112195 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.112350 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.112504 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.112811 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.112981 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.113126 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.113414 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.113599 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.113760 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.114016 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.114178 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.114323 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.114618 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.114805 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.114956 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.115240 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.115385 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.115529 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.115841 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.116006 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.116153 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.116471 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.116675 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.116834 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.117057 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.117206 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.117349 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.117657 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.117816 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.118001 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.118309 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.118463 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.118668 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.118890 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.119042 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.119290 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.119471 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.119621 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.119920 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.120150 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.120312 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.120505 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.120657 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.120809 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.121112 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.121283 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.121429 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.121724 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.121872 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.122027 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.122295 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.122458 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.122643 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.123033 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.123386 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.123793 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.123967 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.124302 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.124469 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.124616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.124942 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.125095 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.125236 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.125560 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.125712 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.125864 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.126136 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.126313 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.126536 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.126901 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.127090 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.127259 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.127412 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.127676 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.127834 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.127956 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.128095 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.128407 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.128591 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.128768 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.129039 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.129232 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.129378 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.129630 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.129869 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.130044 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.130241 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.130458 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.130610 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.130847 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.131008 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.131246 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.131484 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.131632 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.131794 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.132134 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.132299 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.132533 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.132778 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.132930 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.133127 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.133354 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.133531 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.133750 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.134062 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.134217 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.134372 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.134676 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.134986 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.135170 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.135440 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.135694 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.135851 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.136052 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.136307 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.136474 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.136655 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.137055 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.137213 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.137355 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.137584 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.137736 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.137890 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.138166 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.138320 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.139274 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.139616 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.139840 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.140200 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.140446 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.140796 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.140965 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.141201 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.141462 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.141656 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.141925 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.142096 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.142242 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.142545 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.142705 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.142946 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.143160 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.143326 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.143647 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.143811 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.143957 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.144199 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.144353 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.144567 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.144868 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.145023 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.145285 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.145507 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.145662 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.145909 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.146173 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.146328 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.146528 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.146818 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.146972 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.147270 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.147513 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.147650 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.147934 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.148088 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.148248 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.148564 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.148715 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.148890 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.149189 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.149344 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.149501 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.149736 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.149871 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.150115 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.150400 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.150539 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.150789 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.150987 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.151170 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.151497 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.151655 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.151806 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.152165 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.152326 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.152466 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.152595 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.152918 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.153104 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.153234 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.153492 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.153666 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.153805 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.154149 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.154915 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.155186 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.155832 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.155985 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.155985 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.156219 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.156358 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.156517 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.156791 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.156947 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.157244 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.157489 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.157644 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.157933 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.158161 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.158326 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.158530 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.158715 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.158866 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.159222 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.159391 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.159537 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.159785 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.159951 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.160189 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.160344 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.160487 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.160793 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.160959 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.161116 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.161347 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.161500 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.161712 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.161902 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.162066 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.162317 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.162464 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.162609 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.163222 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.163380 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.163545 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.163690 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.163836 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.163836 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.164099 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.164243 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.164458 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.164604 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.164747 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.165045 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.165218 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.165429 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.165588 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.165733 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.165959 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.166106 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.166252 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.166559 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.166715 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.166889 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.167122 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.167277 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.167571 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.167841 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.168047 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.168193 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.168617 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.168617 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.168995 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.169155 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.169155 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.169477 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.169623 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.169837 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.169994 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.170296 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.170569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.170820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.171001 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.171282 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.171450 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.171639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.171898 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.172051 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.172238 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.172478 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.172645 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.172856 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.173044 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.173441 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.173597 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.173778 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.174011 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.174165 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.174413 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.174648 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.174795 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.175038 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.175276 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.175431 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.175603 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.175755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.175987 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.176149 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.176304 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.176601 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.176765 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.176937 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.177200 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.177419 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.177638 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.177838 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.178003 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.178285 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.178442 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.178598 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.178838 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.178993 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.179254 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.179541 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.179724 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.179924 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.180139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.180304 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.180541 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.181028 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.181201 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.181201 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.181479 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.181634 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.181779 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.182059 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.182227 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.182373 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.182670 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.182820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.182981 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.183308 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.183459 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.183604 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.183935 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.184089 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.184247 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.184581 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.184733 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.184888 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.185198 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.185373 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.185815 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.185984 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.186296 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.186762 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.186926 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.187169 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.187446 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.187612 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.187812 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.188018 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.188179 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.188452 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.188694 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.188848 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.189095 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.189243 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.189389 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.189711 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.189877 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.190022 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.190324 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.190475 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.190619 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.190914 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.191198 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.191366 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.191505 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.191649 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.191943 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.192107 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.192268 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.192666 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.192821 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.193057 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.193307 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.193474 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.193695 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.193984 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.194156 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.194311 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.194632 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.194797 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.194945 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.195289 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.195441 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.195585 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.195906 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.196078 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.196241 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.196499 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.196665 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.196808 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.197040 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.197214 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.197398 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.197611 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.197763 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.198007 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.198255 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.198459 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.198635 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.198803 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.198980 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.199273 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.199449 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.199595 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.199871 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.200026 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.200170 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.200420 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.200595 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.200781 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.201636 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.201860 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.202107 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.202312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.202630 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.202777 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.202990 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.203183 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.203330 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.203643 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.203821 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.203971 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.204261 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.204508 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.204663 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.204930 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.205159 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.205323 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.205535 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.205720 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.205937 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.206162 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.206396 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.206558 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.206792 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.206939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.207112 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.207477 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.207627 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.207799 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.208167 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.208376 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.208716 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.208870 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.209025 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.209239 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.209391 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.209692 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.209854 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.209998 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.210238 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.210428 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.210592 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.210857 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.211011 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.211238 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.211527 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.211693 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.211842 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.212146 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.212303 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.212461 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.212756 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.212907 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.213065 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.213382 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.213548 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.213702 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.213944 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.214111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.214286 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.214477 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.214643 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.214915 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.215092 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.215265 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.215548 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.215703 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.215920 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.216081 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.216291 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.216544 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.217320 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.217836 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.217991 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.218280 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.218426 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.218600 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.218865 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.219030 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.219232 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.219554 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.219711 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.219867 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.220085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.220240 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.220494 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.220757 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.220911 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.221231 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.221396 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.221541 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.221797 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.221953 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.222162 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.222449 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.222604 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.222866 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.223017 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.223191 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.223448 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.223598 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.223744 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.224078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.224240 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.224419 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.224704 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.224860 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.225067 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.225296 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.225450 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.225672 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.225820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.225976 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.226279 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.226507 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.226666 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.226900 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.227235 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.227497 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.227713 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.227859 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.228082 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.228247 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.228460 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.228631 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.228803 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.229023 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.229170 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.229324 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.229625 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.229827 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.229999 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.230229 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.230407 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.230558 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.230828 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.230977 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.231163 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.231456 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.231609 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.231752 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.232055 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.232289 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.232520 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.232809 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.233087 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.233474 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.233632 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.233848 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.234021 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.234168 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.234489 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.234643 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.234816 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.235031 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.235309 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.235456 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.235605 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.235748 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.236056 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.236211 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.236509 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.236776 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.236982 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.237129 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.237350 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.237501 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.237659 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.237919 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.238076 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.238261 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.238553 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.238730 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.238875 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.239099 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.239248 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.239526 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.239675 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.239836 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.240156 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.240311 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.240483 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.240756 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.240934 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.241120 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.241306 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.241457 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.241741 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.241891 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.242072 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.242324 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.242478 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.242684 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.242855 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.243003 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.243327 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.243477 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.243622 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.243888 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.244041 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.244247 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.244415 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.244564 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.244870 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.245091 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.245246 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.245501 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.245660 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.245806 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.246129 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.246281 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.246479 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.246772 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.246927 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.247244 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.247463 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.247612 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.247814 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.248211 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.248369 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.248704 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.249007 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.249256 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.249418 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.249580 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.249805 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:23:55.249953 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.250436 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.250870 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.251455 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.251915 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.252341 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.252757 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.253191 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.253731 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.254173 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.254661 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.255253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.255688 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.256231 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.256644 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.257191 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.257715 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.258133 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.258572 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.259132 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.259584 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.260118 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.260533 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.260963 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.261476 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.261884 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.262314 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.262816 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.264246 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.264689 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.265180 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.265753 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.266233 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.266689 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.267327 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.267763 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.268178 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.268691 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.269120 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.269545 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.270092 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.270616 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.271032 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.271462 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.271887 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.272298 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.272701 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.273113 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.273516 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.274024 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.274494 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.274944 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.275477 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.276012 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.276423 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.276916 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.277470 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.277932 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.278365 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.278788 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.279841 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.280352 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.280773 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.281189 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.281592 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.282156 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.282600 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.283023 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.283601 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.284021 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.284457 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.284982 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.285516 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.285978 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.286518 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.286945 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.287543 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.287974 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.288481 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.288919 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.289506 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.290058 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.290521 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.291083 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.291508 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.292062 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.292500 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.293024 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.293434 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.293843 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.294278 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.294856 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.295393 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.296090 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.296522 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.297037 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.297568 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.297966 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.298532 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.299009 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.299564 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.300004 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.300523 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.301048 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.301506 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.302043 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.302474 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.303113 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.303535 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.304033 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.304556 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.304989 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.305396 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.305813 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.306335 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.306739 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.307225 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.307856 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.308284 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.308692 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.309109 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.309632 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.310044 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.311464 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.312206 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.312739 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.313154 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.313713 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.314168 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.314860 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.315417 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.315846 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO dbcounter [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Registered counter for database nova_api Jul 21 22:23:55.316040 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.316489 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.317031 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.317457 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.317952 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.318424 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.318993 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.319454 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.319902 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.320436 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.320974 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.321615 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.322063 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.322594 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.323020 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.323504 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.324030 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.324436 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.324885 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.325297 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.325899 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.326940 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.327390 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.327845 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.328268 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.328681 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.329093 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.329504 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.329956 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.330364 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.331004 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.331459 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.331885 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.332434 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.332873 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.333419 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.333863 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.334277 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.334808 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.335283 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.335870 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.336291 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.336669 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.337092 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.337576 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.337948 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.338547 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.338891 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.339359 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.339886 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.340213 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.340643 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.341049 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.341462 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.341894 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.342302 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.342717 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.343173 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.343577 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.343987 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.344396 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.344829 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.345232 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.346059 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.346390 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.346796 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.347234 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.347651 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.348104 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.348549 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.348982 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.349404 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.349822 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.350509 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.350935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.351551 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.352019 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.352493 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.353001 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.353569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.354071 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.354614 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.355148 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.355684 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.356207 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.356650 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.357160 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.358145 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.358638 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.358968 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.359328 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.359654 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.359975 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.360296 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.360619 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.360932 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.361248 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.361569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.361919 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.362248 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.362766 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.363175 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.363636 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.363964 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.364284 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.364604 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.364972 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.365289 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.365598 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.365914 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.366230 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.366547 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.366891 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.367352 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.367671 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.367985 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.368299 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.368603 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.368915 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.369228 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.369558 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.369898 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.370224 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.370698 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.370858 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.371223 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.371806 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.372264 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.372653 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.373674 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.374066 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.374461 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.374928 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.375319 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.375850 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.376311 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.376871 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.377439 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.377967 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.378765 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.379426 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.379973 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.380719 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.381256 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.382489 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.383199 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.383899 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.384501 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.385036 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.385510 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.385979 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.386526 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.386917 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.387434 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.387768 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.389813 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.389813 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.390130 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.390554 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.391096 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.391466 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.392077 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.392595 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.393183 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.393883 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.394352 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.394675 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.395437 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.395437 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.395744 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.396061 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.396384 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.396703 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.397015 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.397335 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.397650 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.397968 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.398278 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.398614 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.399037 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.399584 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.400069 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.400630 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.401212 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.401939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.402666 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.403432 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.404029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.405204 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.405718 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.406909 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.407558 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.408284 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.408730 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.409166 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.409675 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.410103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.410602 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.411171 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.411780 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.412346 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.412816 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.413236 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.413605 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.413953 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.414273 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.414734 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.415238 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.415677 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.416460 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.417103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.417615 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.418096 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.418803 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.419402 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.420532 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.421108 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.421706 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.422128 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.422587 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.422916 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.423267 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.423600 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.423945 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.424294 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.424739 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.425207 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.425563 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.425857 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.426188 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.426504 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.426829 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.427298 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.427644 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.427974 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.428293 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.428622 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.428965 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.429300 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.429629 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.430050 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.430389 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.430705 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.431332 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.431767 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.432134 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.432455 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.432776 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.433216 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.433557 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.433867 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.433947 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_db.sqlalchemy.engines [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:23:55.434201 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.434643 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.435115 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.435436 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.435772 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.436111 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.436548 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.436855 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.437161 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.437502 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.437882 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.438181 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.438515 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.438942 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.439278 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.439636 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.440188 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.440512 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.440839 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.441161 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.441499 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.441925 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.442174 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writer thread running {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:23:55.442395 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.442734 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.442896 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.443194 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.443530 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.443839 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.444147 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.444606 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.444926 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.445239 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.445579 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.446032 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.446364 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.446672 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.446999 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.447347 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.447680 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.448014 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.448460 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.448878 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.449128 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.449554 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.449872 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.450179 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.450635 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.450956 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.451400 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.451842 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.452168 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.452575 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.452919 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.453439 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.453709 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.454039 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.454397 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.454873 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.455212 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.455710 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.456161 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.456518 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.456834 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.457173 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:55.457543 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:23:55.530062 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO dbcounter [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] Registered counter for database nova_api Jul 21 22:23:55.530323 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.context [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ec464ddc-4674-4af0-a489-3c8a96608528(cell1) {{(pid=103287) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:23:55.536606 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:55.539199 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:55.540406 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:55.543650 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:55.547613 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO dbcounter [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Registered counter for database nova_cell0 Jul 21 22:23:55.554760 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO dbcounter [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Registered counter for database nova_cell1 Jul 21 22:23:55.568630 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_db.sqlalchemy.engines [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:23:55.571687 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_db.sqlalchemy.engines [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:23:55.584778 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writer thread running {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:23:55.585258 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writer thread running {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:23:55.648883 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG oslo_db.sqlalchemy.engines [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:23:55.656376 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG dbcounter [-] [103286] Writer thread running {{(pid=103286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:23:55.718879 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.context [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ec464ddc-4674-4af0-a489-3c8a96608528(cell1) {{(pid=103286) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:23:55.722947 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG oslo_concurrency.lockutils [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:55.724800 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG oslo_concurrency.lockutils [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:55.725665 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG oslo_concurrency.lockutils [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:55.728076 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG oslo_concurrency.lockutils [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:55.730294 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO dbcounter [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] Registered counter for database nova_cell0 Jul 21 22:23:55.735621 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO dbcounter [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] Registered counter for database nova_cell1 Jul 21 22:23:55.746343 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG oslo_db.sqlalchemy.engines [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:23:55.750263 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG oslo_db.sqlalchemy.engines [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:23:55.756686 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG dbcounter [-] [103286] Writer thread running {{(pid=103286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:23:55.757493 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO dbcounter [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Registered counter for database nova_cell0 Jul 21 22:23:55.767857 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_db.sqlalchemy.engines [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:23:55.772999 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writer thread running {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:23:55.912440 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG dbcounter [-] [103286] Writer thread running {{(pid=103286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:23:55.925516 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO dbcounter [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] Registered counter for database nova_cell0 Jul 21 22:23:55.933990 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG oslo_db.sqlalchemy.engines [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:23:55.940576 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG dbcounter [-] [103286] Writer thread running {{(pid=103286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:23:56.169012 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: WARNING keystonemiddleware.auth_token [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:23:56.178057 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: WARNING keystonemiddleware.auth_token [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:23:56.282620 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: WARNING keystonemiddleware.auth_token [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:23:56.290138 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: WARNING keystonemiddleware.auth_token [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:23:56.557540 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: WARNING keystonemiddleware.auth_token [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:23:56.564591 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: WARNING keystonemiddleware.auth_token [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:23:56.570760 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568912a29c0 pid: 103287 (default app) Jul 21 22:23:56.573514 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:56.574906 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002223 Jul 21 22:23:56.577921 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Thu Jul 21 22:23:56 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:23:56.652082 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: WARNING keystonemiddleware.auth_token [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:23:56.658372 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: WARNING keystonemiddleware.auth_token [None req-88aeebda-3d4f-4c57-8c50-20c551eae121 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:23:56.663810 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568912a29c0 pid: 103286 (default app) Jul 21 22:25:18.769402 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:18.770561 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Jul 21 22:25:18.771095 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:25:18.784511 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG dbcounter [-] [103286] Writing DB stats nova_api:SELECT=3 {{(pid=103286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:18.785718 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG dbcounter [-] [103286] Writing DB stats nova_cell0:SELECT=3 {{(pid=103286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:18.786777 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG dbcounter [-] [103286] Writing DB stats nova_cell1:SELECT=3 {{(pid=103286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:18.787821 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG dbcounter [-] [103286] Writing DB stats nova_cell0:SELECT=3 {{(pid=103286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:19.782006 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-41186cb9-bbcd-4bdd-8a23-146c8a3fec0b admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:19.815688 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-41186cb9-bbcd-4bdd-8a23-146c8a3fec0b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.037055 Jul 21 22:25:19.816823 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jul 21 22:25:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:22.134343 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:22.135437 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-b5eed617-eb75-4c1f-a1c2-7725cfc77406 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 21 22:25:22.135876 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:25:22.617871 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-1c2c95f4-6f01-4330-836f-0a92bb05e188 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "id": "c1", "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:22.637528 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:22.637528 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: warnings.warn(msg) Jul 21 22:25:22.669980 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-1c2c95f4-6f01-4330-836f-0a92bb05e188 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.526838 Jul 21 22:25:22.670714 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:25:22.685459 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writing DB stats nova_api:SELECT=3 {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.686574 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writing DB stats nova_cell1:SELECT=3 {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.687506 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writing DB stats nova_cell0:SELECT=3 {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.688519 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.904190 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-31f91558-1686-4ede-a906-d1f9a1ffe420 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:22.908222 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:22.908222 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: warnings.warn(msg) Jul 21 22:25:22.981638 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-31f91558-1686-4ede-a906-d1f9a1ffe420 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.301605 Jul 21 22:25:22.983648 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jul 21 22:25:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:25.389082 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-1c2c95f4-6f01-4330-836f-0a92bb05e188 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:25.390626 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-1c2c95f4-6f01-4330-836f-0a92bb05e188 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001694 Jul 21 22:25:25.391081 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:25:26.372229 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-a9f8eb88-090e-4444-b1a3-0d656a7e2bbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "id": "d1", "rxtx_factor": 1.0}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:26.410472 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:26.410472 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: warnings.warn(msg) Jul 21 22:25:26.444381 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-a9f8eb88-090e-4444-b1a3-0d656a7e2bbc admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.046252 Jul 21 22:25:26.451119 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:26.458917 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-7afc816d-671b-4061-a094-2480f1b26679 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:26.460660 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:26.460660 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: warnings.warn(msg) Jul 21 22:25:26.506538 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-7afc816d-671b-4061-a094-2480f1b26679 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050945 Jul 21 22:25:26.515169 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jul 21 22:25:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:28.995842 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-a9f8eb88-090e-4444-b1a3-0d656a7e2bbc admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:28.996856 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-a9f8eb88-090e-4444-b1a3-0d656a7e2bbc admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 21 22:25:28.997256 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:25:29.512218 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-a883eeb1-cc4c-4a1d-8f8a-4e3ecf4fec7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "name": "ds1G", "swap": 0, "disk": 10}} {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:29.530605 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-a883eeb1-cc4c-4a1d-8f8a-4e3ecf4fec7b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.526136 Jul 21 22:25:29.531142 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:29.542988 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-f57d150b-75a7-4193-9297-3621dfd53dd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:29.567536 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-f57d150b-75a7-4193-9297-3621dfd53dd0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028111 Jul 21 22:25:29.568114 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jul 21 22:25:29 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:31.951935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-a883eeb1-cc4c-4a1d-8f8a-4e3ecf4fec7b admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:31.954126 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-a883eeb1-cc4c-4a1d-8f8a-4e3ecf4fec7b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002302 Jul 21 22:25:31.954744 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:25:32.520750 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-1b217136-98bc-4d11-b8f8-1634acaef0b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:32.551327 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-1b217136-98bc-4d11-b8f8-1634acaef0b8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.589906 Jul 21 22:25:32.552734 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:32.566558 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-c90001ff-316a-45c9-842a-12d6af5bab01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:32.592564 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-c90001ff-316a-45c9-842a-12d6af5bab01 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030291 Jul 21 22:25:32.593849 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jul 21 22:25:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:35.010417 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-1b217136-98bc-4d11-b8f8-1634acaef0b8 admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:35.011487 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-1b217136-98bc-4d11-b8f8-1634acaef0b8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 21 22:25:35.012790 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:25:35.586809 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-1550aae1-25e3-4fb1-b1b3-61aa3f1a9ae3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "vcpus": 4, "swap": 0, "id": "d4"}} {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:35.607762 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-1550aae1-25e3-4fb1-b1b3-61aa3f1a9ae3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.588478 Jul 21 22:25:35.610975 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:25:35.621979 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-0c5439f7-d551-40b8-9179-1135732f1dad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:35.652807 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-0c5439f7-d551-40b8-9179-1135732f1dad admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034731 Jul 21 22:25:35.669204 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jul 21 22:25:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:38.251616 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-1550aae1-25e3-4fb1-b1b3-61aa3f1a9ae3 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:38.252565 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-1550aae1-25e3-4fb1-b1b3-61aa3f1a9ae3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jul 21 22:25:38.252989 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:25:38.797195 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-2a04378c-5fb6-4eda-9da8-250d8b94a11f admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:38.823434 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-2a04378c-5fb6-4eda-9da8-250d8b94a11f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.563892 Jul 21 22:25:38.824275 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jul 21 22:25:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:25:42.181312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-1550aae1-25e3-4fb1-b1b3-61aa3f1a9ae3 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:42.182333 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-1550aae1-25e3-4fb1-b1b3-61aa3f1a9ae3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 21 22:25:42.182744 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:25:42.788680 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-a47c4c65-fca7-43e7-b8bf-f5977926eed2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "1"}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:42.817277 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-a47c4c65-fca7-43e7-b8bf-f5977926eed2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.626765 Jul 21 22:25:42.818640 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:42.835368 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-5562d5bf-29e6-458e-8efa-18c7765ec937 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:42.871224 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-5562d5bf-29e6-458e-8efa-18c7765ec937 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043053 Jul 21 22:25:42.872062 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jul 21 22:25:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:45.317130 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-a47c4c65-fca7-43e7-b8bf-f5977926eed2 admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:45.318154 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-a47c4c65-fca7-43e7-b8bf-f5977926eed2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 21 22:25:45.318604 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:25:45.782534 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-0b3fe825-7747-4a73-b0aa-21af6fe808a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:45.804767 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-0b3fe825-7747-4a73-b0aa-21af6fe808a2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479276 Jul 21 22:25:45.805515 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:25:45.822272 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-5130ebb3-f29d-4d0e-aebb-48c44a8e70f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:45.852775 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-5130ebb3-f29d-4d0e-aebb-48c44a8e70f3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034799 Jul 21 22:25:45.853781 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jul 21 22:25:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:48.383754 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-0b3fe825-7747-4a73-b0aa-21af6fe808a2 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:48.385908 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-0b3fe825-7747-4a73-b0aa-21af6fe808a2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002589 Jul 21 22:25:48.386526 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:25:48.989040 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-7e0a1866-9fea-4357-8345-7d061f03d1c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "swap": 0, "disk": 40, "id": "3", "rxtx_factor": 1.0}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:49.011925 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-7e0a1866-9fea-4357-8345-7d061f03d1c0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.618365 Jul 21 22:25:49.021088 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:49.027291 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-282490bb-c2d9-44b8-91b2-c5f130c76cc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:49.031614 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG dbcounter [-] [103286] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.066518 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-282490bb-c2d9-44b8-91b2-c5f130c76cc7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043399 Jul 21 22:25:49.068077 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jul 21 22:25:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:51.478869 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-7e0a1866-9fea-4357-8345-7d061f03d1c0 admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:51.480510 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-7e0a1866-9fea-4357-8345-7d061f03d1c0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Jul 21 22:25:51.481076 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:25:52.049919 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-c4172415-0eb4-49df-aa86-8d2b0926ed7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:52.072506 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-c4172415-0eb4-49df-aa86-8d2b0926ed7e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.583177 Jul 21 22:25:52.073073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:52.090795 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-32df1428-bf9a-4a86-9b91-670a011ef064 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:52.114909 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-32df1428-bf9a-4a86-9b91-670a011ef064 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032784 Jul 21 22:25:52.116021 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jul 21 22:25:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:54.563621 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-c4172415-0eb4-49df-aa86-8d2b0926ed7e admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:54.565378 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-c4172415-0eb4-49df-aa86-8d2b0926ed7e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002352 Jul 21 22:25:54.566126 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:25:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:25:55.092059 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-21b9eb25-77fd-480b-9f3c-b0ebdb49a0f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "5", "ram": 16384}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:55.110085 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:55.133261 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-21b9eb25-77fd-480b-9f3c-b0ebdb49a0f1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.560409 Jul 21 22:25:55.141484 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:55.147577 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-8dfb06f7-6776-4be7-9d50-9a906f135d04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:55.184220 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-8dfb06f7-6776-4be7-9d50-9a906f135d04 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040581 Jul 21 22:25:55.185304 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jul 21 22:25:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:14.125053 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-21b9eb25-77fd-480b-9f3c-b0ebdb49a0f1 admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:14.126147 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-21b9eb25-77fd-480b-9f3c-b0ebdb49a0f1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Jul 21 22:26:14.126552 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:26:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:14.137625 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG dbcounter [-] [103286] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:14.609774 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-119d7845-7a3a-42c1-9131-a82213bd0426 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:14.627617 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-119d7845-7a3a-42c1-9131-a82213bd0426 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.494298 Jul 21 22:26:14.628179 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jul 21 22:26:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:15.803568 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-21b9eb25-77fd-480b-9f3c-b0ebdb49a0f1 admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:15.804601 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-21b9eb25-77fd-480b-9f3c-b0ebdb49a0f1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Jul 21 22:26:15.805095 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:16.383324 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-ef25c28a-d813-4453-9f6c-8ad75f168df4 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:16.389149 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.wsgi [None req-ef25c28a-d813-4453-9f6c-8ad75f168df4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-ef25c28a-d813-4453-9f6c-8ad75f168df4 admin admin] Request method failure captured: Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Accept: application/json Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Accept-Encoding: gzip, deflate Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Connection: keep-alive Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Content-Length: 0 Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Host: 10.222.0.58 Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Openstack-System-Scope: None Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: User-Agent: python-novaclient Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Auth-Token: gAAAAABi2dKHPeh8iHMASmdA2_h9uV4ErWqL_oQAfONf15Oa1kg7KkoInqpzAJGkDux3f_RJ-4pPvoYqzyd79z7B6M2PPiKvF969kXKU6GSFZiO8Q1SeESSfca6mwEVsF7NF6WEC5pMO1GZtyVXu0Adr-FD-cWpgWJN03zrQXr1aVnQH4lcwMu8 Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Domain-Id: None Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Domain-Name: None Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Identity-Status: Confirmed Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Is-Admin-Project: True Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Domain-Id: default Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Domain-Name: Default Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Name: admin Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Role: member,reader,admin Jul 21 22:26:16.393073 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Roles: member,reader,admin Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1a2e5fa7e325464b9d8cfafd39af8ec6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Tenant: admin Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Tenant-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Tenant-Name: admin Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User: admin Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Domain-Id: default Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Domain-Name: Default Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Id: c37a1ed5575d4f4ab7615ea38d6c47b0 Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Name: admin Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: method: > Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: exception: Flavor 42 could not be found. Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: action_args: {'id': '42'} Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:16.395085 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:16.395939 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:16.397139 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-ef25c28a-d813-4453-9f6c-8ad75f168df4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:16.398335 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-ef25c28a-d813-4453-9f6c-8ad75f168df4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.433442 Jul 21 22:26:16.398335 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jul 21 22:26:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:26:16.405427 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-23d324e5-9f3d-4b12-b2c8-d3b2985199f6 admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:16.429940 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-23d324e5-9f3d-4b12-b2c8-d3b2985199f6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028056 Jul 21 22:26:16.430509 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:16.441506 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-d754e100-4dce-45eb-8dcc-30ee8cb22708 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:16.467472 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-d754e100-4dce-45eb-8dcc-30ee8cb22708 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030387 Jul 21 22:26:16.468169 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:16.477874 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-e50cb974-5fe4-4429-9f1a-198f6ba7a22c admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:16.484263 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.wsgi [None req-e50cb974-5fe4-4429-9f1a-198f6ba7a22c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-e50cb974-5fe4-4429-9f1a-198f6ba7a22c admin admin] Request method failure captured: Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Accept: application/json Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Accept-Encoding: gzip, deflate Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Connection: keep-alive Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Content-Length: 0 Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Host: 10.222.0.58 Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Openstack-System-Scope: None Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: User-Agent: python-novaclient Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Auth-Token: gAAAAABi2dKHPeh8iHMASmdA2_h9uV4ErWqL_oQAfONf15Oa1kg7KkoInqpzAJGkDux3f_RJ-4pPvoYqzyd79z7B6M2PPiKvF969kXKU6GSFZiO8Q1SeESSfca6mwEVsF7NF6WEC5pMO1GZtyVXu0Adr-FD-cWpgWJN03zrQXr1aVnQH4lcwMu8 Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Domain-Id: None Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Domain-Name: None Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Identity-Status: Confirmed Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Is-Admin-Project: True Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Domain-Id: default Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Domain-Name: Default Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Name: admin Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Role: member,reader,admin Jul 21 22:26:16.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Roles: member,reader,admin Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1a2e5fa7e325464b9d8cfafd39af8ec6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Tenant: admin Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Tenant-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Tenant-Name: admin Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User: admin Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Domain-Id: default Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Domain-Name: Default Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Id: c37a1ed5575d4f4ab7615ea38d6c47b0 Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Name: admin Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: method: > Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: exception: Flavor 42 could not be found. Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: action_args: {'id': '42'} Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:16.489616 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:16.490701 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:16.492043 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-e50cb974-5fe4-4429-9f1a-198f6ba7a22c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:16.493074 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-e50cb974-5fe4-4429-9f1a-198f6ba7a22c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015179 Jul 21 22:26:16.493074 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jul 21 22:26:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 21 22:26:17.512701 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-d754e100-4dce-45eb-8dcc-30ee8cb22708 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:17.513731 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-d754e100-4dce-45eb-8dcc-30ee8cb22708 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 21 22:26:17.514129 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:18.076110 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-88c673bb-e7c5-4e32-bab9-84538c1ec09a admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:18.083528 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.wsgi [None req-88c673bb-e7c5-4e32-bab9-84538c1ec09a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-88c673bb-e7c5-4e32-bab9-84538c1ec09a admin admin] Request method failure captured: Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Accept: application/json Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Accept-Encoding: gzip, deflate Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Connection: keep-alive Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Content-Length: 0 Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Host: 10.222.0.58 Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Openstack-System-Scope: None Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: User-Agent: python-novaclient Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Auth-Token: gAAAAABi2dKJdvoIPCr4yZXeAoEEs6BsnnWvCQiXqzNFvlGMQ2E0lJPkpe5i3yvpX5X0UBbBhleCcZaRoN9Yy78p5SNzgqRHoYRYcNlgLUNJqqtRNnhxmtdHi71JcYmkk95jJzRmVAeFbpnbBljnyis_UaUBnV-nbD87wxOj4wKjyw6ZKBO_JQU Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Domain-Id: None Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Domain-Name: None Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Identity-Status: Confirmed Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Is-Admin-Project: True Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Domain-Id: default Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Domain-Name: Default Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Name: admin Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Role: member,reader,admin Jul 21 22:26:18.085086 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Roles: member,reader,admin Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1a2e5fa7e325464b9d8cfafd39af8ec6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Tenant: admin Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Tenant-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Tenant-Name: admin Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User: admin Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Domain-Id: default Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Domain-Name: Default Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Id: c37a1ed5575d4f4ab7615ea38d6c47b0 Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Name: admin Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: method: > Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: exception: Flavor 84 could not be found. Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: action_args: {'id': '84'} Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:18.086690 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:18.087550 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:18.088639 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-88c673bb-e7c5-4e32-bab9-84538c1ec09a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:18.089776 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-88c673bb-e7c5-4e32-bab9-84538c1ec09a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.431529 Jul 21 22:26:18.089776 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jul 21 22:26:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:26:18.098012 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-1f5145f7-0f57-4b06-848a-d2750ac1892f admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:18.111814 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-1f5145f7-0f57-4b06-848a-d2750ac1892f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017468 Jul 21 22:26:18.112396 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:26:18.122330 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-db4edc7d-b66c-4376-8601-ae7583d3b1e4 admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:18.137100 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-db4edc7d-b66c-4376-8601-ae7583d3b1e4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018324 Jul 21 22:26:18.137665 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:18.148493 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-ca176134-c4c8-4b5d-8b56-0cf13b45fb8f admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:18.154505 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.wsgi [None req-ca176134-c4c8-4b5d-8b56-0cf13b45fb8f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-ca176134-c4c8-4b5d-8b56-0cf13b45fb8f admin admin] Request method failure captured: Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Accept: application/json Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Accept-Encoding: gzip, deflate Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Connection: keep-alive Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Content-Length: 0 Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Host: 10.222.0.58 Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Openstack-System-Scope: None Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: User-Agent: python-novaclient Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Auth-Token: gAAAAABi2dKJdvoIPCr4yZXeAoEEs6BsnnWvCQiXqzNFvlGMQ2E0lJPkpe5i3yvpX5X0UBbBhleCcZaRoN9Yy78p5SNzgqRHoYRYcNlgLUNJqqtRNnhxmtdHi71JcYmkk95jJzRmVAeFbpnbBljnyis_UaUBnV-nbD87wxOj4wKjyw6ZKBO_JQU Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Domain-Id: None Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Domain-Name: None Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Identity-Status: Confirmed Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Is-Admin-Project: True Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Domain-Id: default Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Domain-Name: Default Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Name: admin Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Role: member,reader,admin Jul 21 22:26:18.156935 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Roles: member,reader,admin Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1a2e5fa7e325464b9d8cfafd39af8ec6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Tenant: admin Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Tenant-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Tenant-Name: admin Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User: admin Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Domain-Id: default Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Domain-Name: Default Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Id: c37a1ed5575d4f4ab7615ea38d6c47b0 Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Name: admin Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: method: > Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: exception: Flavor 84 could not be found. Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: action_args: {'id': '84'} Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:18.160312 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:18.163820 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:18.167253 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-ca176134-c4c8-4b5d-8b56-0cf13b45fb8f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:18.169252 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-ca176134-c4c8-4b5d-8b56-0cf13b45fb8f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013726 Jul 21 22:26:18.169252 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jul 21 22:26:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:26:19.192168 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-db4edc7d-b66c-4376-8601-ae7583d3b1e4 admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:19.193221 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-db4edc7d-b66c-4376-8601-ae7583d3b1e4 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 21 22:26:19.193644 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:19.766876 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-81585e47-f94e-4b97-906e-096bb66c9a0e admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:19.773055 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.wsgi [None req-81585e47-f94e-4b97-906e-096bb66c9a0e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-81585e47-f94e-4b97-906e-096bb66c9a0e admin admin] Request method failure captured: Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Accept: application/json Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Accept-Encoding: gzip, deflate Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Connection: keep-alive Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Content-Length: 0 Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Host: 10.222.0.58 Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Openstack-System-Scope: None Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: User-Agent: python-novaclient Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Auth-Token: gAAAAABi2dKLN8uQLINXgpjPY-To1HzT18yIJxe5w5ZXpHhpzMSdXMiKlnZoyN9u0f0KhwUWrvR3veNbgAub_QpUC5Gs67IKrzdkqLHevSSpZ3h9fVGZKivGwz3KlGLwekN9mqwgP-MYaG1qL-ig1K-Z9ECPYhbNkBbeXhwE65CI97WcIYb7KuY Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Domain-Id: None Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Domain-Name: None Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Identity-Status: Confirmed Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Is-Admin-Project: True Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Domain-Id: default Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Domain-Name: Default Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Project-Name: admin Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Role: member,reader,admin Jul 21 22:26:19.774569 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Roles: member,reader,admin Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1a2e5fa7e325464b9d8cfafd39af8ec6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Tenant: admin Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Tenant-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-Tenant-Name: admin Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User: admin Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Domain-Id: default Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Domain-Name: Default Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Id: c37a1ed5575d4f4ab7615ea38d6c47b0 Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: X-User-Name: admin Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: method: > Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: exception: Flavor 451 could not be found. Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: action_args: {'id': '451'} Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:19.776103 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:19.776958 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: ERROR nova.api.openstack.wsgi Jul 21 22:26:19.778029 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-81585e47-f94e-4b97-906e-096bb66c9a0e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:19.779318 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-81585e47-f94e-4b97-906e-096bb66c9a0e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.444938 Jul 21 22:26:19.779318 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 22:26:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:26:19.786833 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-c8de2cce-f20b-4ac1-973f-d2a9fcdc752f admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:19.802053 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-c8de2cce-f20b-4ac1-973f-d2a9fcdc752f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018783 Jul 21 22:26:19.802649 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:26:19.813296 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:19.829861 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020383 Jul 21 22:26:19.830442 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:19.840388 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-e3c7474e-1d54-4d4d-8a80-186d17483beb admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:19.846879 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.wsgi [None req-e3c7474e-1d54-4d4d-8a80-186d17483beb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-e3c7474e-1d54-4d4d-8a80-186d17483beb admin admin] Request method failure captured: Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Accept: application/json Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Accept-Encoding: gzip, deflate Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Connection: keep-alive Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Content-Length: 0 Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Host: 10.222.0.58 Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Openstack-System-Scope: None Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: User-Agent: python-novaclient Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Auth-Token: gAAAAABi2dKLN8uQLINXgpjPY-To1HzT18yIJxe5w5ZXpHhpzMSdXMiKlnZoyN9u0f0KhwUWrvR3veNbgAub_QpUC5Gs67IKrzdkqLHevSSpZ3h9fVGZKivGwz3KlGLwekN9mqwgP-MYaG1qL-ig1K-Z9ECPYhbNkBbeXhwE65CI97WcIYb7KuY Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Domain-Id: None Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Domain-Name: None Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Identity-Status: Confirmed Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Is-Admin-Project: True Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Domain-Id: default Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Domain-Name: Default Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Project-Name: admin Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Role: member,reader,admin Jul 21 22:26:19.848505 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Roles: member,reader,admin Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1a2e5fa7e325464b9d8cfafd39af8ec6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1a2e5fa7e325464b9d8cfafd39af8ec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Tenant: admin Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Tenant-Id: 1a2e5fa7e325464b9d8cfafd39af8ec6 Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-Tenant-Name: admin Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User: admin Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Domain-Id: default Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Domain-Name: Default Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Id: c37a1ed5575d4f4ab7615ea38d6c47b0 Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: X-User-Name: admin Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: method: > Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: exception: Flavor 451 could not be found. Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: action_args: {'id': '451'} Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:19.850078 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:19.851111 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: ERROR nova.api.openstack.wsgi Jul 21 22:26:19.852755 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-e3c7474e-1d54-4d4d-8a80-186d17483beb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:19.854061 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-e3c7474e-1d54-4d4d-8a80-186d17483beb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013319 Jul 21 22:26:19.854061 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 22:26:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:26:20.883888 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:20.884928 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Jul 21 22:26:20.885354 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:21.507866 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-044ad5d4-c9e8-4713-8340-63c685718097 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:21.532744 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-044ad5d4-c9e8-4713-8340-63c685718097 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.505048 Jul 21 22:26:21.533304 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jul 21 22:26:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:26:22.547353 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:22.548355 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 Jul 21 22:26:22.548742 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:26:23.135368 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-b487904f-bed3-4e41-b33a-2cba49044ff4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:23.161072 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-b487904f-bed3-4e41-b33a-2cba49044ff4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.463417 Jul 21 22:26:23.161977 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jul 21 22:26:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:24.219348 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:24.220747 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002400 Jul 21 22:26:24.221166 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:24.823554 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-2a2a130e-890c-4589-bfac-9b1d0dd1c448 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:24.842873 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-2a2a130e-890c-4589-bfac-9b1d0dd1c448 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.475899 Jul 21 22:26:24.844011 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jul 21 22:26:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:26:25.895746 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:25.897558 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002875 Jul 21 22:26:25.898341 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:25 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:26.530367 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-ff6576ae-7249-4f3c-9b2c-4f94f73ab400 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:26.550937 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-ff6576ae-7249-4f3c-9b2c-4f94f73ab400 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.512406 Jul 21 22:26:26.551504 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jul 21 22:26:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:26:27.589989 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:27.591004 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 21 22:26:27.591421 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:28.144983 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-789700c3-8946-4fad-99b1-8f492685152c admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:28.164785 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-789700c3-8946-4fad-99b1-8f492685152c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.431986 Jul 21 22:26:28.165326 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Thu Jul 21 22:26:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:27:21.976024 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:21.977621 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-cfd01075-6c1c-48bb-ab8c-5f3cffdeef59 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002433 Jul 21 22:27:21.978356 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jul 21 22:27:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:27:21.989615 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:22.398481 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-25f6eb05-9ade-4062-8d86-b308d675fd25 admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:22.418516 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-25f6eb05-9ade-4062-8d86-b308d675fd25 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.433543 Jul 21 22:27:22.419080 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jul 21 22:27:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:27:22.440474 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG dbcounter [-] [103286] Writing DB stats nova_api:SELECT=14 {{(pid=103286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:22.445197 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-8fd502af-4007-483a-b35e-25a5d5b0920b admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:22.453802 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-8fd502af-4007-483a-b35e-25a5d5b0920b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014898 Jul 21 22:27:22.454338 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1282 bytes} [Thu Jul 21 22:27:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:27:22.466274 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-49409e28-3545-4d31-bcc9-c62ff83ed7db admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:22.480511 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-49409e28-3545-4d31-bcc9-c62ff83ed7db admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017848 Jul 21 22:27:22.481067 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1285 bytes} [Thu Jul 21 22:27:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:27:22.493252 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-59054f8d-fcdc-4fb2-a303-6f005003cb16 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:22.501804 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-59054f8d-fcdc-4fb2-a303-6f005003cb16 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012129 Jul 21 22:27:22.502291 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1285 bytes} [Thu Jul 21 22:27:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:27:22.514055 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-e5d37983-ec80-48e3-975a-8667c058eddc admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:22.522924 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-e5d37983-ec80-48e3-975a-8667c058eddc admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012453 Jul 21 22:27:22.523493 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1282 bytes} [Thu Jul 21 22:27:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:30:43.781730 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-59054f8d-fcdc-4fb2-a303-6f005003cb16 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:30:43.782757 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-59054f8d-fcdc-4fb2-a303-6f005003cb16 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 21 22:30:43.783190 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:30:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:30:43.931394 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writing DB stats nova_api:SELECT=6 {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:44.112878 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-23af2b93-1a13-42a8-b282-799e2fd372ee admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:30:44.114074 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:30:44.114074 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: warnings.warn(msg) Jul 21 22:30:44.115309 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-23af2b93-1a13-42a8-b282-799e2fd372ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:30:44.115756 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-23af2b93-1a13-42a8-b282-799e2fd372ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:30:44.116732 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-23af2b93-1a13-42a8-b282-799e2fd372ee admin admin] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:30:44.117166 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-23af2b93-1a13-42a8-b282-799e2fd372ee admin admin] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:30:44.152508 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-23af2b93-1a13-42a8-b282-799e2fd372ee admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.222758 Jul 21 22:30:44.152996 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 22:30:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:30:45.017093 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-59054f8d-fcdc-4fb2-a303-6f005003cb16 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:30:45.018663 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-59054f8d-fcdc-4fb2-a303-6f005003cb16 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Jul 21 22:30:45.019120 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:30:45.218930 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-74198491-2fa4-4817-8a4f-4e11b9e19b40 admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:30:45.220558 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:30:45.220558 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: warnings.warn(msg) Jul 21 22:30:45.222121 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-74198491-2fa4-4817-8a4f-4e11b9e19b40 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:30:45.222570 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-74198491-2fa4-4817-8a4f-4e11b9e19b40 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:30:45.223842 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-74198491-2fa4-4817-8a4f-4e11b9e19b40 admin admin] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:30:45.224319 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-74198491-2fa4-4817-8a4f-4e11b9e19b40 admin admin] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:30:45.246234 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-74198491-2fa4-4817-8a4f-4e11b9e19b40 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083639 Jul 21 22:30:45.247130 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 22:30:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:30:56.636106 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-59054f8d-fcdc-4fb2-a303-6f005003cb16 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:30:56.637146 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-59054f8d-fcdc-4fb2-a303-6f005003cb16 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 21 22:30:56.637540 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:30:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:30:56.782384 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writing DB stats nova_cell0:SELECT=4 {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:56.783134 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writing DB stats nova_cell1:SELECT=4 {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:56.783744 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG dbcounter [-] [103287] Writing DB stats nova_api:SELECT=8 {{(pid=103287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:56.833403 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-155d9571-82db-44a8-8483-6e5f2e8606fc admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:30:56.834575 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:30:56.834575 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: warnings.warn(msg) Jul 21 22:30:56.835809 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-155d9571-82db-44a8-8483-6e5f2e8606fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:30:56.836256 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-155d9571-82db-44a8-8483-6e5f2e8606fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:30:56.837048 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-155d9571-82db-44a8-8483-6e5f2e8606fc admin admin] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:30:56.837480 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-155d9571-82db-44a8-8483-6e5f2e8606fc admin admin] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:30:56.863032 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-155d9571-82db-44a8-8483-6e5f2e8606fc admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085256 Jul 21 22:30:56.863551 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 22:30:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:30:57.702779 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: DEBUG nova.api.openstack.wsgi [None req-59054f8d-fcdc-4fb2-a303-6f005003cb16 admin admin] Calling method '>' {{(pid=103286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:30:57.703815 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: INFO nova.api.openstack.requestlog [None req-59054f8d-fcdc-4fb2-a303-6f005003cb16 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Jul 21 22:30:57.704220 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: [pid: 103286|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jul 21 22:30:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:30:57.898954 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG nova.api.openstack.wsgi [None req-365b3a76-da5d-479b-86d0-6ef9d98708d7 admin admin] Calling method '>' {{(pid=103287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:30:57.900150 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:30:57.900150 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: warnings.warn(msg) Jul 21 22:30:57.901368 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-365b3a76-da5d-479b-86d0-6ef9d98708d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:30:57.901822 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-365b3a76-da5d-479b-86d0-6ef9d98708d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:30:57.902611 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-365b3a76-da5d-479b-86d0-6ef9d98708d7 admin admin] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:30:57.903038 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: DEBUG oslo_concurrency.lockutils [None req-365b3a76-da5d-479b-86d0-6ef9d98708d7 admin admin] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:30:57.925654 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: INFO nova.api.openstack.requestlog [None req-365b3a76-da5d-479b-86d0-6ef9d98708d7 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078289 Jul 21 22:30:57.926141 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: [pid: 103287|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jul 21 22:30:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:31:55.947549 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: Thu Jul 21 22:31:55 2022 - graceful shutdown triggered... Jul 21 22:31:55.947688 dv-cinder-850698-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 22:31:55.948614 dv-cinder-850698-1-iscsi devstack@n-api.service[103286]: Gracefully killing worker 1 (pid: 103286)... Jul 21 22:31:55.948976 dv-cinder-850698-1-iscsi devstack@n-api.service[103287]: Gracefully killing worker 2 (pid: 103287)... Jul 21 22:31:56.949426 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: worker 1 buried after 1 seconds Jul 21 22:31:56.949426 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: worker 2 buried after 1 seconds Jul 21 22:31:56.949426 dv-cinder-850698-1-iscsi devstack@n-api.service[103285]: goodbye to uWSGI. Jul 21 22:31:56.950941 dv-cinder-850698-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 22:31:56.951525 dv-cinder-850698-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 22:31:56.954906 dv-cinder-850698-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 22:31:56.965189 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 22:31:56.967546 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 22:31:56 2022] *** Jul 21 22:31:56.967546 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 22:31:56.967546 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 22:31:56.967546 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: nodename: dv-cinder-850698-1-iscsi Jul 21 22:31:56.967546 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: machine: x86_64 Jul 21 22:31:56.967546 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: clock source: unix Jul 21 22:31:56.968637 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: pcre jit disabled Jul 21 22:31:56.968637 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: detected number of CPU cores: 4 Jul 21 22:31:56.968637 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: current working directory: / Jul 21 22:31:56.968637 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: detected binary path: /usr/bin/uwsgi-core Jul 21 22:31:56.968637 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: your processes number limit is 47680 Jul 21 22:31:56.968637 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: your memory page size is 4096 bytes Jul 21 22:31:56.968637 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: detected max file descriptor number: 2048 Jul 21 22:31:56.968637 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: lock engine: pthread robust mutexes Jul 21 22:31:56.968637 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: thunder lock: enabled Jul 21 22:31:56.968637 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 22:31:56.969365 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 22:31:57.013028 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: Python main interpreter initialized at 0x55bccaeea9c0 Jul 21 22:31:57.013028 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: python threads support enabled Jul 21 22:31:57.013028 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: your server socket listen backlog is limited to 100 connections Jul 21 22:31:57.013028 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: your mercy for graceful operations on workers is 90 seconds Jul 21 22:31:57.013480 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 22:31:57.013480 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: *** Operational MODE: preforking *** Jul 21 22:31:57.013751 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: *** uWSGI is running in multiple interpreter mode *** Jul 21 22:31:57.013751 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: spawned uWSGI master process (pid: 124489) Jul 21 22:31:57.013964 dv-cinder-850698-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 22:31:57.016297 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: spawned uWSGI worker 1 (pid: 124497, cores: 1) Jul 21 22:31:57.016297 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: spawned uWSGI worker 2 (pid: 124498, cores: 1) Jul 21 22:31:57.016297 dv-cinder-850698-1-iscsi devstack@n-api.service[124489]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 22:31:57.691501 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:31:57.706852 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:31:58.908210 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:31:58.908210 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: from cryptography.utils import int_from_bytes Jul 21 22:31:58.908854 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:31:58.908854 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: from cryptography.utils import int_from_bytes Jul 21 22:31:58.927222 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:31:58.927222 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: from cryptography.utils import int_from_bytes Jul 21 22:31:58.927853 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:31:58.927853 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: from cryptography.utils import int_from_bytes Jul 21 22:32:01.321225 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:32:01.322060 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:32:01.322060 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:32:01.322361 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:32:01.322615 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:32:01.323130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.323403 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.323726 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.324049 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.324388 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.324795 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.325070 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.325396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.325729 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.325992 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.326311 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.326638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850698-1-iscsi {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.326993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.327347 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.327664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.327990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.328295 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.328620 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.328931 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.329581 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.331504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.331504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.331504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.331504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.331504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.331504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.332246 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.332246 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.332516 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.332829 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.333210 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850698-1-iscsi {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.333378 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:32:01.333913 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:32:01.334017 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.334017 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.334168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:32:01.334250 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.334615 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:32:01.334748 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.334872 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:32:01.335014 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.335288 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.335404 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.335615 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.335762 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.335944 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.336052 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.336254 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.336352 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.336587 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.336686 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.336913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.337034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.337279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.337452 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.337639 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.337995 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.338157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.338333 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.338478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.338595 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.338735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.338937 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.339156 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.339310 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.339502 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850698-1-iscsi {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.339709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.339866 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.340022 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.340231 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.340382 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.340560 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.340744 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.340900 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.341048 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.341197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.341423 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.341521 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.341611 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.341611 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.341786 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.341926 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.342256 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.342497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.342633 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.342863 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.343451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.343542 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.343809 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.344211 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.344331 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.344407 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.344600 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.344726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.344969 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.345183 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.345382 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.345716 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.346057 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.346166 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.346255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.346397 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.346666 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.346768 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.346997 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.347140 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.347438 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850698-1-iscsi {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.347531 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.347692 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.347790 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.348008 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.348116 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.348355 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.348455 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.348679 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.348799 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.348992 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.349118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.349315 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.349437 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.349645 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.349765 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.349957 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.350107 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.350267 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.350423 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.350568 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.350757 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.350889 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.351099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.351255 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.351470 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.351578 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.351750 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.352057 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.352171 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.352284 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.352389 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.352475 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.352663 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.352799 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.352990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.353109 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.353296 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.353410 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.353603 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.353719 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.353905 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.354030 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.354171 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.354264 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.354490 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.354645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.354801 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.354912 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.355204 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.355326 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.355425 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.355563 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.355777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.355891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.355987 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.356082 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.356262 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.356363 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.356576 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.356677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.356888 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.357000 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.357200 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.357292 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.357511 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.357602 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.357821 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.357920 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.358126 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.358773 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.358962 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.359189 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.359397 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.359609 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.359701 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.359931 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.360040 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.360259 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.360351 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.360575 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.360681 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.360892 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.360994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.361207 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.361310 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.361532 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.361622 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.361844 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.361940 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.362157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.362254 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.362482 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.362581 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.362804 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.362948 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.363146 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.363254 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.363434 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.363552 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.363748 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.363849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.364057 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.364155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.364363 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.364471 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.364672 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.364771 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.364979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.365076 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.365287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.365403 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.365547 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.365807 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.365923 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.366010 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.366145 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.366247 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.366467 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.366560 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.366789 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.366904 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.367127 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.367261 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.367424 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.367526 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.367745 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.367930 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.368095 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.368264 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.368439 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.368566 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.368883 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.369196 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.369517 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.369646 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.369816 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.369972 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.370142 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.370292 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.370450 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.370642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.370758 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.370982 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.371124 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.371345 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.371464 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.371667 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.371768 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.371982 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.372091 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.372291 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.372402 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.372601 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.372755 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.372932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.373246 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.373437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.373592 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.373728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.374523 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.374793 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.374985 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.375242 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.375457 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.375629 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.375793 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.375939 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.376119 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.376409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.376585 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.376701 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.376869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.377010 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.377252 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.377387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.377523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.377661 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.377800 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.377898 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.377990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.378164 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.378256 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.378478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.378586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.378790 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.378881 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.379120 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.379230 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.379433 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.379533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.379741 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.379840 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.380050 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.380141 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.380354 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.380454 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.380681 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.380779 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.381013 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.381133 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.381321 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.381435 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.381634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.381733 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.381943 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.382045 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.382267 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:01.382371 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.382601 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.382699 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.382917 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.383009 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.383352 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.383474 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.383570 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.383674 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.383903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.383997 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.384223 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.384316 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.384544 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.384636 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.384861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.384952 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.385188 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.385308 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.385505 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.385616 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.385821 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.385921 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.386136 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.386235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.386447 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.386550 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.386756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.386866 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.387087 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.387183 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.387397 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.387491 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.387705 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.387810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.388026 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.388127 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.388349 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.388444 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.388657 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.388756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.388982 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.389073 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.389290 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.389441 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.389634 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.389877 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.389967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.390190 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.390278 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.390536 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.390637 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.390856 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.390956 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.391250 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.391411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.391509 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.391608 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.391891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.392002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.392147 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.392249 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.392456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.392564 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.392782 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.392881 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.393089 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.393170 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.393412 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.393552 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.393712 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.393811 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.394023 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.394118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.394336 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.394442 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.394651 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.394749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.394965 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.395128 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.395322 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.395424 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.395638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.395737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.395953 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.396052 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.396285 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.396383 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.396605 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.396706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.396910 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.397007 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.397481 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.397573 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.397804 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.397903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.398122 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.398253 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.398477 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.398569 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.398784 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.398881 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.399138 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.399277 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.399596 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.399838 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.400017 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.400323 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.400529 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.400707 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.400875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.401038 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.401227 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.401227 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.401550 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.401727 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.401877 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.402025 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.402172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.402328 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.402484 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.403189 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.403357 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.403527 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.403715 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.403878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.404025 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.404200 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.404307 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.404403 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.404490 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.404490 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.404665 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.404825 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.405257 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.405941 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.405941 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.406209 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.406520 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.406832 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.407179 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.407499 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.407630 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.407817 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.407996 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.408126 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.408385 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.408507 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.408746 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.408907 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.409064 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.409186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.409383 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.409504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.409728 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.409905 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.410045 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.410157 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.410363 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.410490 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.410690 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.410825 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.411021 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.411310 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.411487 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.411676 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.411813 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.411959 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.412262 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.412397 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.412573 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.412762 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.412906 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.413184 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.413327 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.413492 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.413704 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.413832 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.414098 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.414407 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.414716 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.414987 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.415151 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.415370 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.415522 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.415682 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.415945 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.416116 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.416295 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.416466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.416644 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.416956 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.417090 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.417303 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.417563 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.417696 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.417953 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.418086 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.418281 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.418501 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.418641 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.418911 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.419065 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.419247 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.419471 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.419646 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.419870 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.420033 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.420171 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.420394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.420535 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.421340 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.421672 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.421983 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.422314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.422486 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.422624 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.422941 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.423216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.423443 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.423659 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.423845 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.424026 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.424341 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.424721 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.424914 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.425089 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.425318 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.425529 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.425741 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.425947 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.426147 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.426329 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.426521 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.426701 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.426879 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.427219 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.427406 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.427599 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.427599 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.427936 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.428113 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.428113 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.428483 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.428674 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.428851 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.429032 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.429032 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.429385 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.429580 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.429779 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.429995 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.429995 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.430388 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.430591 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.430797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.430999 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.430999 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.431484 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.431705 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.431913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.432131 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.432349 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.432566 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.432566 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.432985 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.433191 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.433191 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.433498 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.433631 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.433772 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.433916 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.433916 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.434158 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.434291 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.434291 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.434554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.434846 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.435180 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.435323 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.435487 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.435711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.435865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.436120 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.436263 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.436492 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.437302 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.437629 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.437939 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.438076 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.438258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.438472 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.438635 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.438867 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.439082 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.439261 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.439460 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.439665 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.439867 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.440073 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.440269 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.440452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.440632 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.440822 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.441001 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.441195 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.441391 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.441579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.441758 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.441944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.442136 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.442335 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.442530 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.442530 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.442940 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.443176 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.443176 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.443556 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.443711 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.443845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.443988 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.444128 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.444268 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.444415 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.444753 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.445081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.445400 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.445609 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.445831 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.446037 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.446249 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.446459 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.446649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.446789 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.446936 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.447090 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.447381 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.447520 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.447839 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.447990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.448161 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.448434 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.448579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.448801 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.448951 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.449127 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.449377 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.449522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.449787 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.449920 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.450146 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.450295 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.450464 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.450736 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.450879 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.451106 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.451253 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.451412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.451730 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.451888 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.452072 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.452385 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.452696 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.453089 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.453274 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.453413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.453618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.453812 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.453962 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.454222 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.454362 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.454540 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.454849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.455188 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.455514 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.455688 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.456003 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.456148 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.456378 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.456522 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.456690 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.456925 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.457070 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.457296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.457442 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.457646 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.457856 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.458002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.458290 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.458458 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.458624 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.458975 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.459651 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.459651 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.459927 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.460077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.460218 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.460449 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.460594 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.460823 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.460957 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.461140 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.461387 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.461523 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.461747 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.461882 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.462062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.462322 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.462466 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.462679 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.462857 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.463000 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.463331 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.463527 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.463670 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.463943 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.464094 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.464260 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.464472 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.464616 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.464868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.465174 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.465497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.465779 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.465916 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.466104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.466272 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.466463 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.466713 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.466850 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.467030 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.467229 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.467362 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.467689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.468005 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.468314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.468634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.468874 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.469035 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.469247 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.469384 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.469580 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.469793 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.469929 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.470195 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.470329 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.470504 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.470716 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.470860 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.471145 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.471302 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.471445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.471653 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.471794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.472070 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.472212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.472393 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.472576 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.472710 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.473000 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.473134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.473308 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.473616 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.473760 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.473924 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.474131 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.474266 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.474530 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.474668 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.474837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.475165 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.475475 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.475785 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.475931 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.476113 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.476296 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.476447 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.476726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.476900 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.477045 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.477332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.477500 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.477659 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.477802 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.477968 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.478257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.478402 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.478625 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.478884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.479021 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.479280 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.479425 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.479598 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.479855 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.479991 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.480215 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.480365 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.480523 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.480792 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.480927 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.481141 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.481283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.481458 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.481695 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.481830 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.482061 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.482196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.482385 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.482607 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.482744 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.482999 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.483701 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.483939 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.484271 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.484604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.484915 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.485050 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.485230 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.485548 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.485858 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.486141 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.486278 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.486474 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.486664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.486808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.487113 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.487283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.487419 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.487733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.487881 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.488050 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.488225 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.488371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.488664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.488806 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.488979 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.489275 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.489413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.489605 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.489820 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.489964 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.490214 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.490357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.490528 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.490733 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.490869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.491165 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.491314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.491481 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.491858 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.492002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.492228 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.492370 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.492545 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.492777 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.493000 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.493143 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.493282 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.493457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.493693 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.493830 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.494081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.494343 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.494486 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.494783 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.494929 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.495129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.495449 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.495767 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.496084 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.496226 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.496395 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.496605 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.496750 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.497030 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.497171 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.497340 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.497543 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.497687 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.497943 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.498085 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.498269 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.498479 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.498615 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.498942 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.499896 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.500222 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.500406 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.500570 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.500854 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.501001 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.501249 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.501384 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.501565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.501894 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.502037 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.502221 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.502420 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.502564 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.502846 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.502990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.503190 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.503404 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.503540 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.503819 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.504071 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.504209 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.504453 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.504692 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.504828 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.505066 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.505211 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.505394 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.505720 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.506044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.506364 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.506499 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.506785 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.506921 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.507137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.507305 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.507454 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.507743 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.507897 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.508085 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.508251 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.508394 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.508688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.508839 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.509002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.509281 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.509426 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.509610 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.509773 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.509940 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.510208 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.510345 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.510550 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.510693 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.510867 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.511173 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.511319 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.511502 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.511761 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.511912 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.512125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.512270 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.512435 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.512677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.512819 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.513067 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.513289 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.513433 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.513643 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.513787 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.513986 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.514224 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.514369 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.514648 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.514957 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.515286 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.515690 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.515830 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.516055 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.516363 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.516668 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.516806 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.517011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.517178 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.517357 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.517632 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.517769 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.517973 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.518136 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.518287 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.518582 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.518729 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.518921 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.519114 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.519277 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.522372 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.522549 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.522683 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.522819 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.522965 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.523159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.523323 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.523470 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.523605 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.523746 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.523883 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.524015 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.524157 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.524157 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.524409 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.524551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.524551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.524817 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.524957 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.524957 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.525226 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.525365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.525365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.525365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.525740 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.525881 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.525881 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.525881 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.526286 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.526428 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.526560 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.526691 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.526691 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.526691 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.526691 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.527251 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.527394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.527528 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.527528 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.527795 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.527928 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.528102 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.528248 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.528451 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.528593 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.528771 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.529020 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.529163 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.529395 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.529649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.529794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.530013 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.530254 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.530592 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.530987 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.531321 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.531724 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.531858 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.532113 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.532346 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.532483 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.532742 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.532886 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.533060 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.533278 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.533423 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.533692 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.533832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.534011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.534310 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.534447 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.534632 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.534811 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.534954 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.535296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.535439 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.535626 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.535965 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.536107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.536308 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.536634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.536776 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.536955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.537274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.537407 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.537593 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.537811 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.537953 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.538259 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.538395 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.538571 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.538751 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.538894 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.539234 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.539387 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.539557 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.539876 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.540017 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.540192 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.540411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.540555 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.540817 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.540964 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.541133 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.541321 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.541456 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.541754 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.541973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.542117 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.542346 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.542482 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.542715 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.542858 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.543270 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.543412 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.543545 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.543685 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.543899 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.544045 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.544439 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.546604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.546781 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.546905 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.547032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.547032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.547345 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.547345 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.547612 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.547743 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.547743 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.547743 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.548124 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.548124 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.548371 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.548502 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.548711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.548857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.549036 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.549207 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.549352 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.549665 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.549801 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.549986 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.550238 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.550383 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.550611 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.550745 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.550926 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.551207 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.551542 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.551700 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.551904 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.552230 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.552405 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.552549 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.552856 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.552993 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.553194 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.553330 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.553509 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.553842 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.554022 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.554155 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.554459 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.554601 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.554781 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.554966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.555167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.555421 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.555556 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.555733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.555997 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.556173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.556358 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.556520 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.556670 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.556959 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.557096 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.557269 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.557568 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.557704 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.557901 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.558212 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.558356 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.558525 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.558827 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.558964 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.559177 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.559355 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.559492 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.559790 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.559934 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.560100 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.560384 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.560534 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.560713 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.560877 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.561013 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.561350 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.562010 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.562190 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.562500 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.562815 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.563158 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.563311 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.563529 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.563664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.563842 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.564112 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.564250 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.564461 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.564776 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.564912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.565103 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.565334 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.565477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.565724 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.565877 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.566080 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.566262 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.566406 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.566717 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.566966 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.567185 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.567330 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.567654 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.567787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.567998 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.568337 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.568568 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.568704 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.568949 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.569092 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.569259 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.569481 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.569626 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.569891 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.570107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.570244 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.570505 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.570648 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.570821 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.571026 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.571197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.571464 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.571613 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.571779 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.571972 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.572108 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.572396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.572529 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.572712 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.572897 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.573033 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.573308 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.573494 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.573630 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.573924 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.574064 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.574276 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.574413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.574602 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.574925 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.575158 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.575294 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.575458 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.575593 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.575881 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.576025 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.576203 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.576377 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.576514 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.576819 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.576983 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.577167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.577510 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.577822 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.578134 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.578506 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.578654 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.578880 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.579143 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.579285 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.579457 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.579596 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.579841 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.579978 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.580169 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.580497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.580635 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.580815 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.581039 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.581175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.581432 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.581599 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.581761 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.581949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.582097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.582410 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.582601 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.582751 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.582918 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.583418 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.583570 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.583741 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.583968 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.584112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.584445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.584628 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.584777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.585004 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.585142 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.585313 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.585523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.585669 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.585925 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.586064 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.586241 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.586429 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.586575 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.586998 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.587201 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.587338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.587499 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.587698 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.587850 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.588104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.588395 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.588532 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.588705 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.589014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.589159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.589323 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.589545 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.589681 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.589930 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.590066 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.590240 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.590547 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.590682 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.590865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.591033 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.591212 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.591555 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.591717 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.591852 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.592076 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.592212 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.592491 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.593267 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.593418 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.593655 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.593971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.594302 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.594470 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.594613 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.594935 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.595101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.595272 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.595471 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.595623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.595913 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.596055 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.596231 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.596511 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.596657 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.596857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.596990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.597174 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.597912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.598052 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.598185 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.598327 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.598327 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.598592 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.598741 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.598741 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.599080 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.599495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.599660 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.599804 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.599945 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.600090 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.600359 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.600503 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.600731 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.600952 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.601096 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.601354 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.601497 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.601673 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.601880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.602025 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.602297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.602431 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.602612 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.602808 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.602953 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.603263 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.603401 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.603589 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.603889 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.604036 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.604245 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.604389 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.604563 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.604823 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.604959 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.605216 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.605430 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.605574 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.605885 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.606019 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.606240 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.606583 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.606726 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.606905 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.607246 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.607398 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.607548 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.607746 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.607885 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:32:01.608224 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.610580 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.611023 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.611472 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.611873 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.612563 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.612959 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.613500 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.614298 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.614556 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.614908 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.615311 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.615647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.615985 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.616313 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.616634 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.617007 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.617393 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.617650 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.617974 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.618301 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.618627 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.618954 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.619329 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.619659 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.620183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.620513 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.620988 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.621318 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.621642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.621982 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.622331 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.622685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.623209 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.623375 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.623636 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.625509 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.625847 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.626200 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.626541 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.626880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.627279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.627617 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.627957 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.628274 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.628593 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.628916 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.629234 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.629547 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.629879 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.630364 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.630689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.631045 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.631385 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.631988 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.632349 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.632674 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.633011 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.633345 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.633669 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.633984 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.634313 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.634634 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.634942 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.635291 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.635613 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.635925 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.636237 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.636582 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.636899 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.637210 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.637528 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.637855 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.638193 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.638504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.638815 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.639154 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.640225 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.641261 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.641583 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.643428 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.643916 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.644394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.645005 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.645361 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.645853 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.646201 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.646529 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.646861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.647513 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.647869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.648195 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.648515 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.648853 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.649179 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.649517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.649844 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.650171 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.650543 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.650874 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.651511 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.651864 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.652234 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.652589 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.652934 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.653253 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.653571 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.653885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.654223 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.654544 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.654865 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.655376 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.656150 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.656150 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.657548 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.657548 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.657548 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.657548 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.657825 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.658087 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.658406 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.658725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.659071 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.659465 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.661562 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.661562 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.661562 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.661562 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.661562 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.661562 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.662711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.662711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.662711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.662711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.663038 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.663346 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.663795 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.664120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.664448 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.664779 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.665099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.665428 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.665761 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.666082 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.666409 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.666726 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.667076 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.667439 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.667776 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.668110 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.668423 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.668735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.669046 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.669363 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.669689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.670006 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.670315 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.670625 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.671306 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.671906 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.672117 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.672442 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.672754 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.673070 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.673380 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.673691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.674001 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.674311 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.674619 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.674930 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.675280 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.675590 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.675902 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.676298 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.676538 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.676846 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.677195 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.677537 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.677889 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.678189 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.678510 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.678837 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.679180 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.679513 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.679931 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.680163 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.680479 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.680939 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.681137 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.681458 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.681774 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.682099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.682421 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.682739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.683102 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.683439 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.683753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.684089 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.684417 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.684748 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.685072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.685391 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.685726 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.686045 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.687003 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.687772 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.687772 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.688098 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.688422 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.688739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.689058 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.689382 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.689704 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.690086 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.690372 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.690689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.691187 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.691531 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.691850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.692171 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.692526 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.692865 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.693185 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.693505 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.693821 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:01.694062 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:32:01.762486 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO dbcounter [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] Registered counter for database nova_api Jul 21 22:32:01.784682 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_db.sqlalchemy.engines [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:01.791695 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writer thread running {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:01.845236 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO dbcounter [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] Registered counter for database nova_api Jul 21 22:32:01.849727 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.context [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ec464ddc-4674-4af0-a489-3c8a96608528(cell1) {{(pid=124497) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:32:01.853868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:01.855555 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:01.856380 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:01.858428 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:01.860508 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO dbcounter [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] Registered counter for database nova_cell0 Jul 21 22:32:01.864754 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO dbcounter [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] Registered counter for database nova_cell1 Jul 21 22:32:01.865137 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_db.sqlalchemy.engines [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:01.872174 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writer thread running {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:01.873367 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_db.sqlalchemy.engines [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:01.875722 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_db.sqlalchemy.engines [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:01.881996 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writer thread running {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:01.884145 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writer thread running {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:01.933251 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.context [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ec464ddc-4674-4af0-a489-3c8a96608528(cell1) {{(pid=124498) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:32:01.937952 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:01.939574 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:01.940407 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:01.942451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:01.944523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO dbcounter [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] Registered counter for database nova_cell0 Jul 21 22:32:01.948732 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO dbcounter [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] Registered counter for database nova_cell1 Jul 21 22:32:01.957802 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_db.sqlalchemy.engines [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:01.958776 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_db.sqlalchemy.engines [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:01.964924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writer thread running {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:01.971282 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writer thread running {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:02.036339 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO dbcounter [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] Registered counter for database nova_cell0 Jul 21 22:32:02.043470 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_db.sqlalchemy.engines [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:02.048835 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writer thread running {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:02.119750 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO dbcounter [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] Registered counter for database nova_cell0 Jul 21 22:32:02.127628 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_db.sqlalchemy.engines [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:02.133332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writer thread running {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:02.372936 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: WARNING keystonemiddleware.auth_token [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:32:02.380965 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: WARNING keystonemiddleware.auth_token [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:32:02.458734 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: WARNING keystonemiddleware.auth_token [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:32:02.466472 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: WARNING keystonemiddleware.auth_token [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:32:02.736817 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: WARNING keystonemiddleware.auth_token [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:32:02.743020 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: WARNING keystonemiddleware.auth_token [None req-ef452d3c-81ee-4677-aaf8-fee7fca50b94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:32:02.749967 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bccaeea9c0 pid: 124497 (default app) Jul 21 22:32:02.814233 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: WARNING keystonemiddleware.auth_token [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:32:02.820271 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: WARNING keystonemiddleware.auth_token [None req-65798ed1-6457-461d-b2da-b82a2845a092 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:32:02.826449 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bccaeea9c0 pid: 124498 (default app) Jul 21 22:32:44.928755 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=3 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:44.931713 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=3 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:44.935453 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=3 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:44.937613 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=3 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:45.707006 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-bfe9258d-0656-4bce-bb33-1e1328371072 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] Calling method '.version_select at 0x7f47e8896820>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:45.736573 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=3 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:45.737699 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=3 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:45.738668 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=3 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:45.739696 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=3 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:46.689568 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-cf2b33e3-f39e-4622-9e10-fafd083390b0 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Action: 'create', calling method: .version_select at 0x7f47e87dad30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2104703763", "metadata": {"Type": "work"}}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-cf2b33e3-f39e-4622-9e10-fafd083390b0 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Request method failure captured: Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 122 Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQM-1t5DU868ZAWNVErMiKnrdmpU1S-NH9uNT9o6HAkrQSMqR7LOpscdB1q4iM8j4PQy99LvIAaFMLmfCWjNxgEry8KoabCGfoLnNCzINzdyzI_QLqwUPZEESd1hvsJZ05Ks6-vtk72I3QdKw-Ny54W_bw1-I0J0r3ih4VSub25Bbs Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:32:46.720387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11c72a831a934111b1c89a87f9bc81de", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 2a4393720e844b998ad3d309c06b22f9 Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2104703763", "metadata": {"Type": "work"}}} Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: Jul 21 22:32:46.722065 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2104703763', 'metadata': {'Type': 'work'}}}} Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise error Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:32:46.723077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 22:32:46.724733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 22:32:46.726097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 22:32:46.726097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.726097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-cf2b33e3-f39e-4622-9e10-fafd083390b0 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:32:46.726097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-cf2b33e3-f39e-4622-9e10-fafd083390b0 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.812140 Jul 21 22:32:46.726097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jul 21 22:32:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1814 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:32:46.732717 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3934da52-b4e6-4b4a-b139-e633b61f7138 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Action: 'create', calling method: .version_select at 0x7f47e870c040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2065434998", "metadata": {"Type": "work"}}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3934da52-b4e6-4b4a-b139-e633b61f7138 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Request method failure captured: Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 120 Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQM-1t5DU868ZAWNVErMiKnrdmpU1S-NH9uNT9o6HAkrQSMqR7LOpscdB1q4iM8j4PQy99LvIAaFMLmfCWjNxgEry8KoabCGfoLnNCzINzdyzI_QLqwUPZEESd1hvsJZ05Ks6-vtk72I3QdKw-Ny54W_bw1-I0J0r3ih4VSub25Bbs Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:32:46.738578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11c72a831a934111b1c89a87f9bc81de", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 2a4393720e844b998ad3d309c06b22f9 Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2065434998", "metadata": {"Type": "work"}}} Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: Jul 21 22:32:46.740167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2065434998', 'metadata': {'Type': 'work'}}}} Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise error Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi '0' Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:32:46.741063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 22:32:46.742565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 22:32:46.743880 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 22:32:46.743880 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.743880 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3934da52-b4e6-4b4a-b139-e633b61f7138 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:32:46.743880 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3934da52-b4e6-4b4a-b139-e633b61f7138 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011874 Jul 21 22:32:46.744350 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 2/2] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jul 21 22:32:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:32:46.755433 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6ef2da9c-a5e9-4512-832b-d1686ca6f322 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Action: 'create', calling method: .version_select at 0x7f47e87f6160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-241193119", "metadata": {"Type": "work"}}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6ef2da9c-a5e9-4512-832b-d1686ca6f322 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Request method failure captured: Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 118 Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQM-1t5DU868ZAWNVErMiKnrdmpU1S-NH9uNT9o6HAkrQSMqR7LOpscdB1q4iM8j4PQy99LvIAaFMLmfCWjNxgEry8KoabCGfoLnNCzINzdyzI_QLqwUPZEESd1hvsJZ05Ks6-vtk72I3QdKw-Ny54W_bw1-I0J0r3ih4VSub25Bbs Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:32:46.758082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11c72a831a934111b1c89a87f9bc81de", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 2a4393720e844b998ad3d309c06b22f9 Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-241193119", "metadata": {"Type": "work"}}} Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: Jul 21 22:32:46.759411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-241193119', 'metadata': {'Type': 'work'}}}} Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise error Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi '' Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:32:46.760197 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 22:32:46.761465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 22:32:46.762629 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 22:32:46.762629 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:46.762629 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6ef2da9c-a5e9-4512-832b-d1686ca6f322 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:32:46.762629 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6ef2da9c-a5e9-4512-832b-d1686ca6f322 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012927 Jul 21 22:32:46.762629 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 3/3] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jul 21 22:32:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:32:46.776714 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2e261dca-1f36-4330-851b-4f9e90843e66 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Calling method '.version_select at 0x7f47e870cca0>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:47.347666 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-2e261dca-1f36-4330-851b-4f9e90843e66 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] HTTP exception thrown: Volume tempest-invalid-382941707 could not be found. Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2e261dca-1f36-4330-851b-4f9e90843e66 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Request method failure captured: Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-382941707 HTTP/1.1 Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQM-1t5DU868ZAWNVErMiKnrdmpU1S-NH9uNT9o6HAkrQSMqR7LOpscdB1q4iM8j4PQy99LvIAaFMLmfCWjNxgEry8KoabCGfoLnNCzINzdyzI_QLqwUPZEESd1hvsJZ05Ks6-vtk72I3QdKw-Ny54W_bw1-I0J0r3ih4VSub25Bbs Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:32:47.352274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11c72a831a934111b1c89a87f9bc81de", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 2a4393720e844b998ad3d309c06b22f9 Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Volume tempest-invalid-382941707 could not be found. Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'tempest-invalid-382941707'} Jul 21 22:32:47.353777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-382941707 could not be found. (HTTP 404) (Request-ID: req-4e2d7dea-44f2-4cfa-8c97-8df5cfa514d1) Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:47.354538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:32:47.355971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-382941707 could not be found. Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:32:47.357296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-382941707 could not be found. Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-382941707 could not be found. Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2e261dca-1f36-4330-851b-4f9e90843e66 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Returning 404 to user: Volume tempest-invalid-382941707 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2e261dca-1f36-4330-851b-4f9e90843e66 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-382941707" status: 404 len: 98 microversion: 2.1 time: 0.584632 Jul 21 22:32:47.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 4/4] 10.222.0.58 () {58 vars in 1214 bytes} [Thu Jul 21 22:32:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-382941707 => generated 98 bytes in 586 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 21 22:32:47.365043 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-bfe9258d-0656-4bce-bb33-1e1328371072 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1c463657-12fd-4e44-91b3-cfd1d5a33b96" status: 200 len: 351 microversion: 2.1 time: 2.063712 Jul 21 22:32:47.365641 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 1/5] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:32:45 2022] GET /compute/v2.1/os-volumes/1c463657-12fd-4e44-91b3-cfd1d5a33b96 => generated 351 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:32:47.372707 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b54ed58f-545e-4f09-a85c-af0283b49a05 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003995 Jul 21 22:32:47.381813 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-94b2bc88-3781-4378-9e78-ea2ec2f1673c tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004260 Jul 21 22:32:47.383632 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 5/6] 10.222.0.58 () {58 vars in 1139 bytes} [Thu Jul 21 22:32:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 22:32:47.386628 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 2/7] 10.222.0.58 () {58 vars in 1136 bytes} [Thu Jul 21 22:32:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 22:32:47.399904 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7973e1a4-bd39-4034-b35a-749273762d65 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Calling method '.version_select at 0x7f47e8628e50>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:47.553957 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-7973e1a4-bd39-4034-b35a-749273762d65 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] HTTP exception thrown: Volume 869b7b47-8eb3-42a6-bd25-18a5c70cab57 could not be found. Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7973e1a4-bd39-4034-b35a-749273762d65 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Request method failure captured: Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: DELETE /compute/v2.1/os-volumes/869b7b47-8eb3-42a6-bd25-18a5c70cab57 HTTP/1.1 Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQM-1t5DU868ZAWNVErMiKnrdmpU1S-NH9uNT9o6HAkrQSMqR7LOpscdB1q4iM8j4PQy99LvIAaFMLmfCWjNxgEry8KoabCGfoLnNCzINzdyzI_QLqwUPZEESd1hvsJZ05Ks6-vtk72I3QdKw-Ny54W_bw1-I0J0r3ih4VSub25Bbs Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:32:47.556258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11c72a831a934111b1c89a87f9bc81de", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 2a4393720e844b998ad3d309c06b22f9 Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Volume 869b7b47-8eb3-42a6-bd25-18a5c70cab57 could not be found. Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': '869b7b47-8eb3-42a6-bd25-18a5c70cab57'} Jul 21 22:32:47.557645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 869b7b47-8eb3-42a6-bd25-18a5c70cab57 could not be found. (HTTP 404) (Request-ID: req-79623fb0-5d04-4ad1-aa38-f4c6e606c03b) Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:47.558579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:32:47.560409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 869b7b47-8eb3-42a6-bd25-18a5c70cab57 could not be found. Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 22:32:47.561643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:32:47.562969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 869b7b47-8eb3-42a6-bd25-18a5c70cab57 could not be found. Jul 21 22:32:47.562969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.562969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:47.562969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.562969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:47.562969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:47.562969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:47.562969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:32:47.562969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:32:47.562969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 869b7b47-8eb3-42a6-bd25-18a5c70cab57 could not be found. Jul 21 22:32:47.562969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:32:47.566073 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7973e1a4-bd39-4034-b35a-749273762d65 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Returning 404 to user: Volume 869b7b47-8eb3-42a6-bd25-18a5c70cab57 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:32:47.566301 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7973e1a4-bd39-4034-b35a-749273762d65 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/869b7b47-8eb3-42a6-bd25-18a5c70cab57" status: 404 len: 109 microversion: 2.1 time: 0.176200 Jul 21 22:32:47.567436 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 6/8] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 22:32:47 2022] DELETE /compute/v2.1/os-volumes/869b7b47-8eb3-42a6-bd25-18a5c70cab57 => generated 109 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:32:47.578332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1e1b3f3a-10c4-4fd1-a678-4287c7fb0ff2 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Calling method '.version_select at 0x7f47e86e6dc0>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:48.172559 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-1e1b3f3a-10c4-4fd1-a678-4287c7fb0ff2 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] HTTP exception thrown: Volume 68e66ecc-1480-483c-865a-17509fecb77d could not be found. Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1e1b3f3a-10c4-4fd1-a678-4287c7fb0ff2 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Request method failure captured: Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/os-volumes/68e66ecc-1480-483c-865a-17509fecb77d HTTP/1.1 Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQM-1t5DU868ZAWNVErMiKnrdmpU1S-NH9uNT9o6HAkrQSMqR7LOpscdB1q4iM8j4PQy99LvIAaFMLmfCWjNxgEry8KoabCGfoLnNCzINzdyzI_QLqwUPZEESd1hvsJZ05Ks6-vtk72I3QdKw-Ny54W_bw1-I0J0r3ih4VSub25Bbs Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:32:48.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11c72a831a934111b1c89a87f9bc81de", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11c72a831a934111b1c89a87f9bc81de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 11c72a831a934111b1c89a87f9bc81de Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-VolumesNegativeTest-547330238 Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: 2a4393720e844b998ad3d309c06b22f9 Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-VolumesNegativeTest-547330238-project Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Volume 68e66ecc-1480-483c-865a-17509fecb77d could not be found. Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '68e66ecc-1480-483c-865a-17509fecb77d'} Jul 21 22:32:48.178688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68e66ecc-1480-483c-865a-17509fecb77d could not be found. (HTTP 404) (Request-ID: req-39274332-4f24-47c4-9e69-fdf5be602c10) Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:48.179979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:32:48.181399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68e66ecc-1480-483c-865a-17509fecb77d could not be found. Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 22:32:48.182694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68e66ecc-1480-483c-865a-17509fecb77d could not be found. Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68e66ecc-1480-483c-865a-17509fecb77d could not be found. Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1e1b3f3a-10c4-4fd1-a678-4287c7fb0ff2 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] Returning 404 to user: Volume 68e66ecc-1480-483c-865a-17509fecb77d could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1e1b3f3a-10c4-4fd1-a678-4287c7fb0ff2 tempest-VolumesNegativeTest-547330238 tempest-VolumesNegativeTest-547330238-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/68e66ecc-1480-483c-865a-17509fecb77d" status: 404 len: 109 microversion: 2.1 time: 0.605679 Jul 21 22:32:48.183949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 3/9] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:32:47 2022] GET /compute/v2.1/os-volumes/68e66ecc-1480-483c-865a-17509fecb77d => generated 109 bytes in 607 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:32:49.478299 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a703eeb9-2815-4f28-9d5f-4d791aac61ab tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] Calling method '.version_select at 0x7f47e8644040>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:49.614772 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a703eeb9-2815-4f28-9d5f-4d791aac61ab tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/efa02c57-c3d0-4d85-88e7-40887a5f35c4" status: 200 len: 351 microversion: 2.1 time: 0.140370 Jul 21 22:32:49.616630 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 7/10] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:32:49 2022] GET /compute/v2.1/os-volumes/efa02c57-c3d0-4d85-88e7-40887a5f35c4 => generated 351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:32:51.161416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7f0f5b4f-709e-4ae4-8f44-3dae530e02ff tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] Calling method '.version_select at 0x7f47e86133a0>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:51.454003 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7f0f5b4f-709e-4ae4-8f44-3dae530e02ff tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7db3f71a-7963-4024-9a3b-0790809884d9" status: 200 len: 351 microversion: 2.1 time: 0.296530 Jul 21 22:32:51.454663 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 4/11] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:32:51 2022] GET /compute/v2.1/os-volumes/7db3f71a-7963-4024-9a3b-0790809884d9 => generated 351 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:32:51.467286 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-13495490-021d-4902-a933-efe4ff717c45 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] Calling method '.version_select at 0x7f47e86449d0>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:51.693678 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-13495490-021d-4902-a933-efe4ff717c45 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.231457 Jul 21 22:32:51.695967 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 8/12] 10.222.0.58 () {58 vars in 1133 bytes} [Thu Jul 21 22:32:51 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:32:51.710169 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2f7f6332-bdc8-46a0-bec1-77c39a3eaf21 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] Calling method '.version_select at 0x7f47e86e6e50>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:51.905621 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2f7f6332-bdc8-46a0-bec1-77c39a3eaf21 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.198821 Jul 21 22:32:51.907071 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 5/13] 10.222.0.58 () {58 vars in 1148 bytes} [Thu Jul 21 22:32:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:32:51.923268 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c0c037ba-b8e5-43b0-b2d9-90d890f1626a tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] Calling method '.version_select at 0x7f47e8644f70>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:52.154914 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c0c037ba-b8e5-43b0-b2d9-90d890f1626a tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.238612 Jul 21 22:32:52.155545 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 9/14] 10.222.0.58 () {58 vars in 1133 bytes} [Thu Jul 21 22:32:51 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:32:52.168531 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7aab5606-e28a-44cc-8308-6e54469f5765 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] Calling method '.version_select at 0x7f47e8613940>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:52.302013 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7aab5606-e28a-44cc-8308-6e54469f5765 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.137856 Jul 21 22:32:52.303104 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 6/15] 10.222.0.58 () {58 vars in 1166 bytes} [Thu Jul 21 22:32:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:32:52.317104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-212fcfce-a1bd-47cd-8876-3c8a17ce80c6 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] Calling method '.version_select at 0x7f47e85db040>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:52.472819 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-212fcfce-a1bd-47cd-8876-3c8a17ce80c6 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.160609 Jul 21 22:32:52.473441 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 10/16] 10.222.0.58 () {58 vars in 1169 bytes} [Thu Jul 21 22:32:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:32:52.492793 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-30bfb9a5-7115-431c-b1dc-3abc88b0e51f tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] Calling method '.version_select at 0x7f47e8613dc0>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:52.632845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-30bfb9a5-7115-431c-b1dc-3abc88b0e51f tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.144763 Jul 21 22:32:52.633499 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 7/17] 10.222.0.58 () {58 vars in 1154 bytes} [Thu Jul 21 22:32:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:32:52.649552 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-739d49d8-d966-4d0b-9051-bc718c971bae tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] Calling method '.version_select at 0x7f47e85dbca0>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:53.246302 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-739d49d8-d966-4d0b-9051-bc718c971bae tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.604162 Jul 21 22:32:53.249641 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 11/18] 10.222.0.58 () {58 vars in 1187 bytes} [Thu Jul 21 22:32:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:32:53.267443 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e9ef524b-9861-489b-8ddf-81a9404d4ce8 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] Calling method '.version_select at 0x7f47e86e6ee0>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:53.517838 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e9ef524b-9861-489b-8ddf-81a9404d4ce8 tempest-VolumesTestJSON-1488612447 tempest-VolumesTestJSON-1488612447-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.258146 Jul 21 22:32:53.518797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 8/19] 10.222.0.58 () {58 vars in 1154 bytes} [Thu Jul 21 22:32:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:01.636191 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-101613520", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:01.799785 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] validate_networks() for [('5a9b553d-ef3b-4e67-b2f3-50140476634a', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:33:03.874809 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1458081553", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "networks": [{"uuid": "7c2a4a64-4eae-477a-9d6f-4ecddc9ce25f"}]}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:04.056414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:33:04.056964 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:33:04.057297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:33:04.057708 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:33:04.058117 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:33:04.084397 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.network.neutron [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] validate_networks() for [('7c2a4a64-4eae-477a-9d6f-4ecddc9ce25f', None, None, None, None, None)] {{(pid=124498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:33:04.098106 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:04.098689 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:04.099577 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:04.103016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:04.213311 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Getting quotas for project 3138cf3bb8a24ba19295565fca0a471e. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:33:04.240146 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Getting quotas for user cf3fd4428e3b46cd9e83e1d32571097b and project 3138cf3bb8a24ba19295565fca0a471e. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:33:04.288895 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:33:04.301963 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:33:04.522652 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f8cc47b3-4408-4298-b16f-23bf3da9b508 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.427171 Jul 21 22:33:04.525757 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 12/20] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:33:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:33:04.538020 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f1057ae4-f0bf-49e3-bf4c-b1b673ac3e70 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:04.549224 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f1057ae4-f0bf-49e3-bf4c-b1b673ac3e70 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:04.899810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f1057ae4-f0bf-49e3-bf4c-b1b673ac3e70 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:04.962227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f1057ae4-f0bf-49e3-bf4c-b1b673ac3e70 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1221 microversion: 2.1 time: 0.426614 Jul 21 22:33:04.967502 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 13/21] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:04 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1221 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:06.113272 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-bedda707-a53a-48eb-9d86-20314dce9d4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Action: 'create', calling method: .version_select at 0x7f47e74ede50>, body: {"keypair": {"name": "tempest-keypair-2100871951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQj96IjWqJEHvKsTWuF5iReKKGmkG463eyq5aI3jNxqbZlmEqxDS8FYm/5lY8246GD2Ka4LJVVokaM2lKzKpxicKB1oeDwkDp+I9rl+6RjJGTTAKk1Z+iMLXfPqppCX0w=="}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:06.186389 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-bedda707-a53a-48eb-9d86-20314dce9d4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Getting quotas for project 3b9849b45b2d414797c0cb368b787ddf. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:33:06.205890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-bedda707-a53a-48eb-9d86-20314dce9d4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Getting quotas for user a6146c8083d04171863a4b603fd6a46c and project 3b9849b45b2d414797c0cb368b787ddf. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:33:06.389764 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-bedda707-a53a-48eb-9d86-20314dce9d4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.358968 Jul 21 22:33:06.391049 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 14/22] 10.222.0.58 () {62 vars in 1199 bytes} [Thu Jul 21 22:33:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1362 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 22:33:06.410347 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1309512940", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:06.547326 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Flavor limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:33:06.547942 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Image limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:33:06.548337 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Flavor pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:33:06.548744 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Image pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:33:06.549195 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:33:06.584186 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] validate_networks() for [('5a9b553d-ef3b-4e67-b2f3-50140476634a', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:33:06.607329 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:06.608685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:06.611852 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:06.618772 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:06.743120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Getting quotas for project 7f7d739ba4574964821462bf4be0e1f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:33:06.772797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Getting quotas for user 2c07a46f581b4bbb97ad99005471ebe3 and project 7f7d739ba4574964821462bf4be0e1f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:33:06.821285 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Going to run 1 instances... {{(pid=124498) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:33:06.824217 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:33:07.090957 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d1bfe846-1b5c-47ba-9939-1dc34590a0c7 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.558091 Jul 21 22:33:07.091987 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 9/23] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:33:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:33:07.811324 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b27c39c0-b035-4223-80c7-47e5c5ce77cd tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Action: 'create', calling method: .version_select at 0x7f47e7d18670>, body: {"keypair": {"name": "tempest-keypair-1272355326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdqNcCKAe6wVGizf09qB6RfGT81CUyr2dDwzH17LuP+Jyp17j+LgAyu5H3unkmxmij7AGRvGdMPJ5C5AFEk7CU0yUZCnq4ahZW3sHKaK7+srNjEIov1IBwN6wpk6jdisg=="}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:07.900120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-b27c39c0-b035-4223-80c7-47e5c5ce77cd tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Getting quotas for project d54636d00282483381454b9be56a43b5. Resources: {'key_pairs'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:33:07.925749 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-b27c39c0-b035-4223-80c7-47e5c5ce77cd tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Getting quotas for user 1ee22783b3234c4f905fedce7d59f01d and project d54636d00282483381454b9be56a43b5. Resources: {'key_pairs'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:33:08.059290 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b27c39c0-b035-4223-80c7-47e5c5ce77cd tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.960794 Jul 21 22:33:08.065608 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 10/24] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 22:33:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:08.092503 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6eab55d9-4479-405c-ae60-7a9df774ae92 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:08.093310 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6eab55d9-4479-405c-ae60-7a9df774ae92 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:08.390986 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6eab55d9-4479-405c-ae60-7a9df774ae92 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:08.450330 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:33:08.451087 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:33:08.451872 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:33:08.452127 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:33:08.452547 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:33:08.492351 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6eab55d9-4479-405c-ae60-7a9df774ae92 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1215 microversion: 2.1 time: 0.424074 Jul 21 22:33:08.493178 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 11/25] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:08 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1215 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:08.504547 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:08.505090 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:08.505994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:08.506432 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:08.620380 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Getting quotas for project 3138cf3bb8a24ba19295565fca0a471e. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:33:08.648126 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Getting quotas for user cf3fd4428e3b46cd9e83e1d32571097b and project 3138cf3bb8a24ba19295565fca0a471e. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:33:08.707198 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:33:08.716382 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:33:08.977379 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b3831b22-a3ba-48c4-b107-ff1fe03fdfa6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.575128 Jul 21 22:33:08.979032 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 15/26] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:33:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:33:08.989681 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f09575a6-b89d-42c2-b3aa-403c5753ec2e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:08.991089 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f09575a6-b89d-42c2-b3aa-403c5753ec2e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:09.105812 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f09575a6-b89d-42c2-b3aa-403c5753ec2e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:09.119722 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f09575a6-b89d-42c2-b3aa-403c5753ec2e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1222 microversion: 2.1 time: 0.133632 Jul 21 22:33:09.122087 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 12/27] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:08 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1222 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:09.511267 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-845fdeed-556a-4ad5-b3ff-2594808c4eb5 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:09.513106 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-845fdeed-556a-4ad5-b3ff-2594808c4eb5 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:09.819475 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-845fdeed-556a-4ad5-b3ff-2594808c4eb5 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:09.832849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-845fdeed-556a-4ad5-b3ff-2594808c4eb5 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1215 microversion: 2.1 time: 0.326438 Jul 21 22:33:09.855621 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 16/28] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:09 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1215 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:10.139520 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-155ec0b3-cf72-45de-a938-c521b407ef7c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:10.141589 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-155ec0b3-cf72-45de-a938-c521b407ef7c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:10.331949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-155ec0b3-cf72-45de-a938-c521b407ef7c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:10.341827 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-155ec0b3-cf72-45de-a938-c521b407ef7c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1222 microversion: 2.1 time: 0.207023 Jul 21 22:33:10.343766 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 13/29] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:10 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1222 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:10.856363 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-fa4d618e-724d-4a7e-867e-cfa91432f619 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:10.857641 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-fa4d618e-724d-4a7e-867e-cfa91432f619 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:10.891698 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fa4d618e-724d-4a7e-867e-cfa91432f619 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:10.893179 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fa4d618e-724d-4a7e-867e-cfa91432f619 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:10.894218 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fa4d618e-724d-4a7e-867e-cfa91432f619 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:10.894864 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fa4d618e-724d-4a7e-867e-cfa91432f619 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:11.380949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4efbccd3-3b30-41cf-acfa-1ae26b131188 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:11.382976 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4efbccd3-3b30-41cf-acfa-1ae26b131188 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:11.434198 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4efbccd3-3b30-41cf-acfa-1ae26b131188 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:11.437665 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4efbccd3-3b30-41cf-acfa-1ae26b131188 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:11.441151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4efbccd3-3b30-41cf-acfa-1ae26b131188 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:11.442650 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4efbccd3-3b30-41cf-acfa-1ae26b131188 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:12.018939 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-fa4d618e-724d-4a7e-867e-cfa91432f619 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:12.060186 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-fa4d618e-724d-4a7e-867e-cfa91432f619 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1267 microversion: 2.1 time: 1.208745 Jul 21 22:33:12.065594 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 17/30] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:10 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1267 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:12.126571 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4efbccd3-3b30-41cf-acfa-1ae26b131188 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:12.167131 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4efbccd3-3b30-41cf-acfa-1ae26b131188 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1274 microversion: 2.1 time: 0.805588 Jul 21 22:33:12.167332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 14/31] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:11 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1274 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:13.086812 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-cfc8b26e-ad3f-416a-9f9c-e97af935ff46 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:13.089261 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-cfc8b26e-ad3f-416a-9f9c-e97af935ff46 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:13.110227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cfc8b26e-ad3f-416a-9f9c-e97af935ff46 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:13.111812 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cfc8b26e-ad3f-416a-9f9c-e97af935ff46 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:13.126763 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cfc8b26e-ad3f-416a-9f9c-e97af935ff46 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:13.129395 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cfc8b26e-ad3f-416a-9f9c-e97af935ff46 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:13.187927 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-de743941-26de-421e-b645-b11dde7e9952 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:13.188759 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-de743941-26de-421e-b645-b11dde7e9952 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:13.214205 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-de743941-26de-421e-b645-b11dde7e9952 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:13.218232 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-de743941-26de-421e-b645-b11dde7e9952 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:13.219817 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-de743941-26de-421e-b645-b11dde7e9952 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:13.221335 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-de743941-26de-421e-b645-b11dde7e9952 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:13.708755 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-de743941-26de-421e-b645-b11dde7e9952 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:13.718116 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-de743941-26de-421e-b645-b11dde7e9952 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1280 microversion: 2.1 time: 0.537299 Jul 21 22:33:13.722768 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 15/32] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:13 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1280 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:13.763270 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-cfc8b26e-ad3f-416a-9f9c-e97af935ff46 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:13.813064 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-cfc8b26e-ad3f-416a-9f9c-e97af935ff46 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1273 microversion: 2.1 time: 0.724014 Jul 21 22:33:13.814580 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 18/33] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:13 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1273 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:14.743295 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f8c8feb2-a351-4eb0-baf7-8553d06fa220 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:14.745013 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f8c8feb2-a351-4eb0-baf7-8553d06fa220 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:14.759081 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f8c8feb2-a351-4eb0-baf7-8553d06fa220 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:14.762229 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f8c8feb2-a351-4eb0-baf7-8553d06fa220 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:14.764525 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f8c8feb2-a351-4eb0-baf7-8553d06fa220 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:14.765452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f8c8feb2-a351-4eb0-baf7-8553d06fa220 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:14.838928 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f42eb575-08f3-44da-b2d5-646e54027b8b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:14.843319 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f42eb575-08f3-44da-b2d5-646e54027b8b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:14.868825 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f42eb575-08f3-44da-b2d5-646e54027b8b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:14.869892 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f42eb575-08f3-44da-b2d5-646e54027b8b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:14.874809 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f42eb575-08f3-44da-b2d5-646e54027b8b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:14.877058 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f42eb575-08f3-44da-b2d5-646e54027b8b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:15.025536 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f8c8feb2-a351-4eb0-baf7-8553d06fa220 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:15.053604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f8c8feb2-a351-4eb0-baf7-8553d06fa220 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1280 microversion: 2.1 time: 0.314472 Jul 21 22:33:15.067633 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 16/34] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:14 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:15.143834 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f42eb575-08f3-44da-b2d5-646e54027b8b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:15.158165 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f42eb575-08f3-44da-b2d5-646e54027b8b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1273 microversion: 2.1 time: 0.329837 Jul 21 22:33:15.163795 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 19/35] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:14 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1273 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:16.016969 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1478689609", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99f805e3-2429-4430-a2c2-07da14cced17"}], "security_groups": [{"name": "tempest-securitygroup--183465684"}], "key_name": "tempest-keypair-1272355326", "user_data": "}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:16.073775 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4cc06dd7-e4ca-467b-8a67-0b01f44da58b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:16.075161 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4cc06dd7-e4ca-467b-8a67-0b01f44da58b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:16.094104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4cc06dd7-e4ca-467b-8a67-0b01f44da58b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:16.099504 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4cc06dd7-e4ca-467b-8a67-0b01f44da58b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:16.111474 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4cc06dd7-e4ca-467b-8a67-0b01f44da58b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:16.112131 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4cc06dd7-e4ca-467b-8a67-0b01f44da58b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:16.405951 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.network.neutron [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] validate_networks() for [('99f805e3-2429-4430-a2c2-07da14cced17', None, None, None, None, None)] {{(pid=124498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:33:16.501296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4cc06dd7-e4ca-467b-8a67-0b01f44da58b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:16.514002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4cc06dd7-e4ca-467b-8a67-0b01f44da58b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1280 microversion: 2.1 time: 0.441879 Jul 21 22:33:16.514862 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 20/36] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:16 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1280 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:16.527578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7799044f-7176-4ba7-a673-a7818f33c3ae tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:16.536595 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7799044f-7176-4ba7-a673-a7818f33c3ae tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:16.550260 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7799044f-7176-4ba7-a673-a7818f33c3ae tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:16.551278 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7799044f-7176-4ba7-a673-a7818f33c3ae tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:16.554869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7799044f-7176-4ba7-a673-a7818f33c3ae tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:16.555593 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7799044f-7176-4ba7-a673-a7818f33c3ae tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:16.671627 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:16.743383 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7799044f-7176-4ba7-a673-a7818f33c3ae tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:16.764082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7799044f-7176-4ba7-a673-a7818f33c3ae tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1273 microversion: 2.1 time: 0.245537 Jul 21 22:33:16.764718 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 21/37] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:16 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:17.463140 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-822085136", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97db9e2f-db43-41a4-8fd7-1761944b3315"}], "security_groups": [{"name": "tempest-securitygroup--401448114"}], "key_name": "tempest-keypair-2100871951", "user_data": "}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:17.706633 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Flavor limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:33:17.707686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Image limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:33:17.708333 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Flavor pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:33:17.709610 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Image pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:33:17.710219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:33:17.724681 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:17.729198 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:17.731500 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:17.733345 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:17.772132 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] validate_networks() for [('97db9e2f-db43-41a4-8fd7-1761944b3315', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:33:17.787738 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Getting quotas for project d54636d00282483381454b9be56a43b5. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:33:17.799453 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Getting quotas for user 1ee22783b3234c4f905fedce7d59f01d and project d54636d00282483381454b9be56a43b5. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:33:17.830781 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Going to run 1 instances... {{(pid=124498) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:33:17.844182 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:33:18.030366 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-371e9687-510a-43f0-a315-ba3ecc4e4fd4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.017653 Jul 21 22:33:18.037007 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 17/38] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:33:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 2028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:33:18.050716 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7acb50f2-26ba-4e04-8c94-5fa01dcf826a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:18.051365 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7acb50f2-26ba-4e04-8c94-5fa01dcf826a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:18.077425 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7acb50f2-26ba-4e04-8c94-5fa01dcf826a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:18.077980 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7acb50f2-26ba-4e04-8c94-5fa01dcf826a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:18.078792 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7acb50f2-26ba-4e04-8c94-5fa01dcf826a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:18.079271 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7acb50f2-26ba-4e04-8c94-5fa01dcf826a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:18.562612 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=4 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:19.093441 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7acb50f2-26ba-4e04-8c94-5fa01dcf826a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:19.106976 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7acb50f2-26ba-4e04-8c94-5fa01dcf826a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 1.070338 Jul 21 22:33:19.108044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 18/39] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:18 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:19.118975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c3ad81ba-13a6-4775-b68d-1d39ce9be06a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:19.120343 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c3ad81ba-13a6-4775-b68d-1d39ce9be06a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:19.147339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c3ad81ba-13a6-4775-b68d-1d39ce9be06a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:19.149030 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c3ad81ba-13a6-4775-b68d-1d39ce9be06a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:19.164261 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c3ad81ba-13a6-4775-b68d-1d39ce9be06a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:19.164925 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c3ad81ba-13a6-4775-b68d-1d39ce9be06a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:19.338667 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:33:19.341206 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:33:19.341851 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:33:19.342372 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:33:19.342921 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:33:19.360046 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:19.360688 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:19.361889 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:19.363385 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:19.418379 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Getting quotas for project 3b9849b45b2d414797c0cb368b787ddf. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:33:19.426650 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Getting quotas for user a6146c8083d04171863a4b603fd6a46c and project 3b9849b45b2d414797c0cb368b787ddf. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:33:19.460585 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:33:19.466418 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:33:19.518247 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c3ad81ba-13a6-4775-b68d-1d39ce9be06a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:19.533924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c3ad81ba-13a6-4775-b68d-1d39ce9be06a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 0.419805 Jul 21 22:33:19.534899 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 19/40] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:19 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:19.541009 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f397ac34-4557-493d-8637-b12c7481f0b9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:19.541983 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f397ac34-4557-493d-8637-b12c7481f0b9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:19.555088 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f397ac34-4557-493d-8637-b12c7481f0b9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:19.555540 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f397ac34-4557-493d-8637-b12c7481f0b9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:19.558472 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f397ac34-4557-493d-8637-b12c7481f0b9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:19.559035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f397ac34-4557-493d-8637-b12c7481f0b9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:19.569805 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f8c733cb-3c41-4629-8f0f-9a5e7bc624f3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.113370 Jul 21 22:33:19.576884 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 22/41] 10.222.0.58 () {62 vars in 1187 bytes} [Thu Jul 21 22:33:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 21 22:33:19.585373 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7dd885b2-7181-43c8-9348-3eb2a168523f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:19.586930 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7dd885b2-7181-43c8-9348-3eb2a168523f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:19.664892 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f397ac34-4557-493d-8637-b12c7481f0b9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:19.678305 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f397ac34-4557-493d-8637-b12c7481f0b9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1242 microversion: 2.1 time: 0.138281 Jul 21 22:33:19.688831 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 20/42] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:19 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1242 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:19.750658 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7dd885b2-7181-43c8-9348-3eb2a168523f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:19.773669 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7dd885b2-7181-43c8-9348-3eb2a168523f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:19.781948 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7dd885b2-7181-43c8-9348-3eb2a168523f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:19.786670 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7dd885b2-7181-43c8-9348-3eb2a168523f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1281 microversion: 2.20 time: 0.205007 Jul 21 22:33:19.798661 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 23/43] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:19 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1281 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:20.127489 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c6ae2b1a-d7c0-4029-b2b8-42ac1ce69d71 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:20.130733 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c6ae2b1a-d7c0-4029-b2b8-42ac1ce69d71 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:20.138855 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c6ae2b1a-d7c0-4029-b2b8-42ac1ce69d71 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:20.146092 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c6ae2b1a-d7c0-4029-b2b8-42ac1ce69d71 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:20.147727 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c6ae2b1a-d7c0-4029-b2b8-42ac1ce69d71 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:20.148375 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c6ae2b1a-d7c0-4029-b2b8-42ac1ce69d71 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:20.456006 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c6ae2b1a-d7c0-4029-b2b8-42ac1ce69d71 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:20.466911 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c6ae2b1a-d7c0-4029-b2b8-42ac1ce69d71 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.346115 Jul 21 22:33:20.479496 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 21/44] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:20 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:20.567851 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4e34f9b3-e9a5-4c76-ab73-839585644f75 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:20.569650 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4e34f9b3-e9a5-4c76-ab73-839585644f75 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:20.608407 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4e34f9b3-e9a5-4c76-ab73-839585644f75 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:20.610407 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4e34f9b3-e9a5-4c76-ab73-839585644f75 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:20.612466 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4e34f9b3-e9a5-4c76-ab73-839585644f75 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:20.616314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4e34f9b3-e9a5-4c76-ab73-839585644f75 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:20.696264 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ed73a02a-682f-452e-a928-4244766be700 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:20.697360 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ed73a02a-682f-452e-a928-4244766be700 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:20.711929 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ed73a02a-682f-452e-a928-4244766be700 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:20.712745 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ed73a02a-682f-452e-a928-4244766be700 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:20.713895 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ed73a02a-682f-452e-a928-4244766be700 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:20.729468 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ed73a02a-682f-452e-a928-4244766be700 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:20.917463 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ed73a02a-682f-452e-a928-4244766be700 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:20.938075 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ed73a02a-682f-452e-a928-4244766be700 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1242 microversion: 2.1 time: 0.243675 Jul 21 22:33:20.940852 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 22/45] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:20 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1242 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:20.951300 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-dc1ed25f-299c-4ac3-a098-62a32849e713 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:20.952160 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-dc1ed25f-299c-4ac3-a098-62a32849e713 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:20.958936 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dc1ed25f-299c-4ac3-a098-62a32849e713 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:20.959658 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dc1ed25f-299c-4ac3-a098-62a32849e713 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:20.961239 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dc1ed25f-299c-4ac3-a098-62a32849e713 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:20.961899 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dc1ed25f-299c-4ac3-a098-62a32849e713 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:21.146214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-dc1ed25f-299c-4ac3-a098-62a32849e713 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:21.182181 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-dc1ed25f-299c-4ac3-a098-62a32849e713 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:21.184998 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-dc1ed25f-299c-4ac3-a098-62a32849e713 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:21.187855 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-dc1ed25f-299c-4ac3-a098-62a32849e713 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1285 microversion: 2.20 time: 0.243672 Jul 21 22:33:21.194957 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:20 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:21.419938 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4e34f9b3-e9a5-4c76-ab73-839585644f75 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:21.432793 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4e34f9b3-e9a5-4c76-ab73-839585644f75 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 0.882432 Jul 21 22:33:21.438695 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 24/47] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:20 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:21.487794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5d4abdad-819c-481f-b071-af62e59e5343 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:21.488630 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-5d4abdad-819c-481f-b071-af62e59e5343 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:21.506739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d4abdad-819c-481f-b071-af62e59e5343 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:21.509694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d4abdad-819c-481f-b071-af62e59e5343 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:21.514703 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d4abdad-819c-481f-b071-af62e59e5343 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:21.516435 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d4abdad-819c-481f-b071-af62e59e5343 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:21.961803 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d1e64df9-4cc7-4a5e-81c9-b65070e32a07 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:21.962466 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d1e64df9-4cc7-4a5e-81c9-b65070e32a07 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:21.988106 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1e64df9-4cc7-4a5e-81c9-b65070e32a07 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:21.990967 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1e64df9-4cc7-4a5e-81c9-b65070e32a07 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:21.992204 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1e64df9-4cc7-4a5e-81c9-b65070e32a07 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:21.994007 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1e64df9-4cc7-4a5e-81c9-b65070e32a07 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:22.013555 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5d4abdad-819c-481f-b071-af62e59e5343 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:22.024725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5d4abdad-819c-481f-b071-af62e59e5343 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.540801 Jul 21 22:33:22.036757 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 24/48] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:21 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:22.193522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d1e64df9-4cc7-4a5e-81c9-b65070e32a07 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:22.212104 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-77056238-d581-401e-a020-30908bcaa8ab tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:22.213930 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-77056238-d581-401e-a020-30908bcaa8ab tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:22.224589 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d1e64df9-4cc7-4a5e-81c9-b65070e32a07 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1290 microversion: 2.1 time: 0.265477 Jul 21 22:33:22.237089 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 25/49] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:21 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1290 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:22.238027 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77056238-d581-401e-a020-30908bcaa8ab tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:22.238027 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77056238-d581-401e-a020-30908bcaa8ab tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:22.238027 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77056238-d581-401e-a020-30908bcaa8ab tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:22.238027 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77056238-d581-401e-a020-30908bcaa8ab tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:22.385535 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-77056238-d581-401e-a020-30908bcaa8ab tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:22.401285 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-77056238-d581-401e-a020-30908bcaa8ab tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:22.406009 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-77056238-d581-401e-a020-30908bcaa8ab tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:22.409712 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-77056238-d581-401e-a020-30908bcaa8ab tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1333 microversion: 2.20 time: 0.202739 Jul 21 22:33:22.413018 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 25/50] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:22 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1333 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:22.454325 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-fdb90760-ffcf-4480-8494-650b8b1fdb96 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:22.454952 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-fdb90760-ffcf-4480-8494-650b8b1fdb96 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:22.465841 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fdb90760-ffcf-4480-8494-650b8b1fdb96 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:22.466544 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fdb90760-ffcf-4480-8494-650b8b1fdb96 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:22.467618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fdb90760-ffcf-4480-8494-650b8b1fdb96 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:22.468599 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fdb90760-ffcf-4480-8494-650b8b1fdb96 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:23.043756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e01a75ca-2a58-4af5-a3ef-f0bb3f2a28f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:23.045021 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e01a75ca-2a58-4af5-a3ef-f0bb3f2a28f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:23.065110 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e01a75ca-2a58-4af5-a3ef-f0bb3f2a28f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:23.066792 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e01a75ca-2a58-4af5-a3ef-f0bb3f2a28f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:23.067653 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e01a75ca-2a58-4af5-a3ef-f0bb3f2a28f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:23.068124 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e01a75ca-2a58-4af5-a3ef-f0bb3f2a28f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:23.884295 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-fdb90760-ffcf-4480-8494-650b8b1fdb96 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:23.897738 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-fdb90760-ffcf-4480-8494-650b8b1fdb96 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 1.451233 Jul 21 22:33:23.900479 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 26/51] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:22 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:23.913811 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-380ef2ec-8f8a-4a20-8d88-0ada74b65a32 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:23.915449 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-380ef2ec-8f8a-4a20-8d88-0ada74b65a32 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:23.944016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-380ef2ec-8f8a-4a20-8d88-0ada74b65a32 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:23.946071 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-380ef2ec-8f8a-4a20-8d88-0ada74b65a32 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:23.951825 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-380ef2ec-8f8a-4a20-8d88-0ada74b65a32 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:23.952744 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-380ef2ec-8f8a-4a20-8d88-0ada74b65a32 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:24.128080 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-380ef2ec-8f8a-4a20-8d88-0ada74b65a32 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:24.141369 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-380ef2ec-8f8a-4a20-8d88-0ada74b65a32 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1296 microversion: 2.1 time: 0.237408 Jul 21 22:33:24.149221 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 27/52] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:23 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1296 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:24.164208 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-fe2105c9-63f5-4b67-864a-a335a037d5b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:24.166079 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-fe2105c9-63f5-4b67-864a-a335a037d5b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:24.188016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fe2105c9-63f5-4b67-864a-a335a037d5b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:24.190253 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fe2105c9-63f5-4b67-864a-a335a037d5b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:24.195208 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fe2105c9-63f5-4b67-864a-a335a037d5b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:24.196314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fe2105c9-63f5-4b67-864a-a335a037d5b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:24.455611 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e01a75ca-2a58-4af5-a3ef-f0bb3f2a28f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:24.469992 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e01a75ca-2a58-4af5-a3ef-f0bb3f2a28f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 1.431229 Jul 21 22:33:24.471093 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 26/53] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:23 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:24.597549 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-fe2105c9-63f5-4b67-864a-a335a037d5b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:24.618471 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-fe2105c9-63f5-4b67-864a-a335a037d5b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:24.621332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-fe2105c9-63f5-4b67-864a-a335a037d5b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:24.622694 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-fe2105c9-63f5-4b67-864a-a335a037d5b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1339 microversion: 2.20 time: 0.472123 Jul 21 22:33:24.623314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 28/54] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:24 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1339 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:24.921964 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6a36977f-9c1b-4d51-93c5-eb88c6b000d1 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:24.923916 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6a36977f-9c1b-4d51-93c5-eb88c6b000d1 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:24.940404 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6a36977f-9c1b-4d51-93c5-eb88c6b000d1 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:24.943756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6a36977f-9c1b-4d51-93c5-eb88c6b000d1 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:24.944887 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6a36977f-9c1b-4d51-93c5-eb88c6b000d1 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:24.946608 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6a36977f-9c1b-4d51-93c5-eb88c6b000d1 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:25.165528 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-429e6e5d-3ac0-4cda-9d3b-896c67cec0ac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:25.166201 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-429e6e5d-3ac0-4cda-9d3b-896c67cec0ac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:25.190119 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-429e6e5d-3ac0-4cda-9d3b-896c67cec0ac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:25.193422 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-429e6e5d-3ac0-4cda-9d3b-896c67cec0ac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:25.196040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-429e6e5d-3ac0-4cda-9d3b-896c67cec0ac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:25.197027 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-429e6e5d-3ac0-4cda-9d3b-896c67cec0ac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:25.847331 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-429e6e5d-3ac0-4cda-9d3b-896c67cec0ac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:25.859441 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-429e6e5d-3ac0-4cda-9d3b-896c67cec0ac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1296 microversion: 2.1 time: 0.697462 Jul 21 22:33:25.860612 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 29/55] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:25 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1296 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:25.866402 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5ad09902-f69c-43df-9f46-c86964f1f6d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:25.867359 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5ad09902-f69c-43df-9f46-c86964f1f6d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:25.880717 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5ad09902-f69c-43df-9f46-c86964f1f6d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:25.881472 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5ad09902-f69c-43df-9f46-c86964f1f6d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:25.882598 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5ad09902-f69c-43df-9f46-c86964f1f6d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:25.883925 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5ad09902-f69c-43df-9f46-c86964f1f6d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:26.025296 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6a36977f-9c1b-4d51-93c5-eb88c6b000d1 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:26.039540 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6a36977f-9c1b-4d51-93c5-eb88c6b000d1 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 1.125833 Jul 21 22:33:26.040784 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 27/56] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:24 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:26.057378 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c78fa088-9106-40dc-88ce-dba8b074ff93 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:26.059125 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c78fa088-9106-40dc-88ce-dba8b074ff93 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:26.091434 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c78fa088-9106-40dc-88ce-dba8b074ff93 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:26.092371 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c78fa088-9106-40dc-88ce-dba8b074ff93 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:26.093421 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c78fa088-9106-40dc-88ce-dba8b074ff93 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:26.094069 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c78fa088-9106-40dc-88ce-dba8b074ff93 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:26.425288 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-5ad09902-f69c-43df-9f46-c86964f1f6d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:26.439986 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-5ad09902-f69c-43df-9f46-c86964f1f6d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.577143 Jul 21 22:33:26.446147 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 30/57] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:25 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:26.622650 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c78fa088-9106-40dc-88ce-dba8b074ff93 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:26.658205 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c78fa088-9106-40dc-88ce-dba8b074ff93 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:26.661404 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c78fa088-9106-40dc-88ce-dba8b074ff93 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:26.689350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c78fa088-9106-40dc-88ce-dba8b074ff93 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1339 microversion: 2.20 time: 0.635481 Jul 21 22:33:26.690676 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 28/58] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:26 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1339 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:26.878035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1293af8d-5d69-4516-9d48-24305d9d064f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:26.879161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1293af8d-5d69-4516-9d48-24305d9d064f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:26.895711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1293af8d-5d69-4516-9d48-24305d9d064f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:26.897049 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1293af8d-5d69-4516-9d48-24305d9d064f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:26.900400 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1293af8d-5d69-4516-9d48-24305d9d064f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:26.901159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1293af8d-5d69-4516-9d48-24305d9d064f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:27.058908 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-b92332f5-83d8-4ac3-95c4-6172616067b7 req-c7b1a3b1-7758-40e8-831e-7bd2f6f6a21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2256ebb9-3077-4700-bdc1-bdfd57d082a5", "tag": "9d9b621d-5324-47aa-be89-af4177fdd319"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:27.074365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:27.083148 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-b92332f5-83d8-4ac3-95c4-6172616067b7 req-c7b1a3b1-7758-40e8-831e-7bd2f6f6a21f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:27.083591 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-b92332f5-83d8-4ac3-95c4-6172616067b7 req-c7b1a3b1-7758-40e8-831e-7bd2f6f6a21f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:27.140972 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1293af8d-5d69-4516-9d48-24305d9d064f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:27.152430 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-b92332f5-83d8-4ac3-95c4-6172616067b7 req-c7b1a3b1-7758-40e8-831e-7bd2f6f6a21f service nova] Creating event network-changed:9d9b621d-5324-47aa-be89-af4177fdd319 for instance 2256ebb9-3077-4700-bdc1-bdfd57d082a5 on hv-cinder-85069 Jul 21 22:33:27.153206 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-b92332f5-83d8-4ac3-95c4-6172616067b7 req-c7b1a3b1-7758-40e8-831e-7bd2f6f6a21f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124497) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 22:33:27.155836 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-847f482e-5d2f-4cc7-b52c-f6b23ee29b33 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:27.156425 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1293af8d-5d69-4516-9d48-24305d9d064f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1296 microversion: 2.1 time: 0.281267 Jul 21 22:33:27.159539 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 29/59] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:26 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1296 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:27.168577 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-847f482e-5d2f-4cc7-b52c-f6b23ee29b33 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:27.169868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-847f482e-5d2f-4cc7-b52c-f6b23ee29b33 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:27.171366 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-847f482e-5d2f-4cc7-b52c-f6b23ee29b33 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:27.172666 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8c3180f0-be7d-47a4-814c-a782745c0d7b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:27.177254 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8c3180f0-be7d-47a4-814c-a782745c0d7b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:27.196191 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8c3180f0-be7d-47a4-814c-a782745c0d7b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:27.196737 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8c3180f0-be7d-47a4-814c-a782745c0d7b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:27.200066 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8c3180f0-be7d-47a4-814c-a782745c0d7b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:27.200437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8c3180f0-be7d-47a4-814c-a782745c0d7b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:27.209526 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.compute.rpcapi [None req-847f482e-5d2f-4cc7-b52c-f6b23ee29b33 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 22:33:27.210991 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-847f482e-5d2f-4cc7-b52c-f6b23ee29b33 None None] Releasing lock "compute-rpcapi-router" {{(pid=124497) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 22:33:27.252929 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-847f482e-5d2f-4cc7-b52c-f6b23ee29b33 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.805042 Jul 21 22:33:27.253797 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:27.463505 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-75279725-c77f-4140-a5eb-b616ebe046b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:27.467427 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-75279725-c77f-4140-a5eb-b616ebe046b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:27.488119 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-75279725-c77f-4140-a5eb-b616ebe046b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:27.489089 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-75279725-c77f-4140-a5eb-b616ebe046b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:27.490882 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-75279725-c77f-4140-a5eb-b616ebe046b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:27.491707 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-75279725-c77f-4140-a5eb-b616ebe046b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:27.757504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:27.821933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=22 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:28.259070 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8c3180f0-be7d-47a4-814c-a782745c0d7b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:28.266707 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=100 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:28.270296 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8c3180f0-be7d-47a4-814c-a782745c0d7b tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 1.109370 Jul 21 22:33:28.277236 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 30/61] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:27 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:28.296791 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-30f7bd35-8c0b-49eb-8c8d-a0800e398a88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:28.298367 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-30f7bd35-8c0b-49eb-8c8d-a0800e398a88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:28.327636 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-30f7bd35-8c0b-49eb-8c8d-a0800e398a88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:28.328521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-30f7bd35-8c0b-49eb-8c8d-a0800e398a88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:28.329550 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-30f7bd35-8c0b-49eb-8c8d-a0800e398a88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:28.330144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-30f7bd35-8c0b-49eb-8c8d-a0800e398a88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:28.439828 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-75279725-c77f-4140-a5eb-b616ebe046b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:28.455790 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-75279725-c77f-4140-a5eb-b616ebe046b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.998030 Jul 21 22:33:28.457088 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 32/62] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:27 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:28.467446 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b94e1a88-f165-47a6-8a04-19a9572e2721 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:28.468798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b94e1a88-f165-47a6-8a04-19a9572e2721 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:28.478657 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b94e1a88-f165-47a6-8a04-19a9572e2721 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:28.479261 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b94e1a88-f165-47a6-8a04-19a9572e2721 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:28.480514 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b94e1a88-f165-47a6-8a04-19a9572e2721 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:28.481105 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b94e1a88-f165-47a6-8a04-19a9572e2721 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:28.649792 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b94e1a88-f165-47a6-8a04-19a9572e2721 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:28.662629 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b94e1a88-f165-47a6-8a04-19a9572e2721 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1296 microversion: 2.1 time: 0.203270 Jul 21 22:33:28.664347 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 33/63] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:28 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1296 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:28.783012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-30f7bd35-8c0b-49eb-8c8d-a0800e398a88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:28.796911 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-30f7bd35-8c0b-49eb-8c8d-a0800e398a88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:28.800569 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-30f7bd35-8c0b-49eb-8c8d-a0800e398a88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:28.802091 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-30f7bd35-8c0b-49eb-8c8d-a0800e398a88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.523168 Jul 21 22:33:28.814122 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 31/64] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:28 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:29.297170 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0546e259-daae-48db-92d7-59af5d2878d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:29.297911 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0546e259-daae-48db-92d7-59af5d2878d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:29.330805 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0546e259-daae-48db-92d7-59af5d2878d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:29.333499 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0546e259-daae-48db-92d7-59af5d2878d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:29.335919 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0546e259-daae-48db-92d7-59af5d2878d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:29.341897 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0546e259-daae-48db-92d7-59af5d2878d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:29.471706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-198faef5-4172-4cab-a362-0ea96c4e11cb req-287313e6-c09e-49ad-832b-469a64e4c4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967535ed-7748-4181-a946-d67bfbb813d0", "tag": "a64b5308-fbc3-42f2-a21e-3de790b55a40"}, {"name": "network-changed", "server_uuid": "0d2d5c65-369e-40c5-9218-9be17b9bf09b", "tag": "a9c8cd4d-fcdb-4161-9b9c-20c9deff216d"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:29.493677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-198faef5-4172-4cab-a362-0ea96c4e11cb req-287313e6-c09e-49ad-832b-469a64e4c4e1 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:29.494386 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-198faef5-4172-4cab-a362-0ea96c4e11cb req-287313e6-c09e-49ad-832b-469a64e4c4e1 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:29.519350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-198faef5-4172-4cab-a362-0ea96c4e11cb req-287313e6-c09e-49ad-832b-469a64e4c4e1 service nova] Creating event network-changed:a64b5308-fbc3-42f2-a21e-3de790b55a40 for instance 967535ed-7748-4181-a946-d67bfbb813d0 on hv-cinder-85069 Jul 21 22:33:29.520142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-198faef5-4172-4cab-a362-0ea96c4e11cb req-287313e6-c09e-49ad-832b-469a64e4c4e1 service nova] Creating event network-changed:a9c8cd4d-fcdb-4161-9b9c-20c9deff216d for instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b on hv-cinder-85069 Jul 21 22:33:29.520919 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-198faef5-4172-4cab-a362-0ea96c4e11cb req-287313e6-c09e-49ad-832b-469a64e4c4e1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124498) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 22:33:29.522686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c5b075d2-0afa-4773-9cf0-7b9155235081 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:29.523311 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c5b075d2-0afa-4773-9cf0-7b9155235081 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:29.524259 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c5b075d2-0afa-4773-9cf0-7b9155235081 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:29.524887 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c5b075d2-0afa-4773-9cf0-7b9155235081 None None] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:29.537537 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.compute.rpcapi [None req-c5b075d2-0afa-4773-9cf0-7b9155235081 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 22:33:29.538784 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c5b075d2-0afa-4773-9cf0-7b9155235081 None None] Releasing lock "compute-rpcapi-router" {{(pid=124498) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 22:33:29.569189 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c5b075d2-0afa-4773-9cf0-7b9155235081 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.103529 Jul 21 22:33:29.582510 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 32/65] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:29.582510 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1fa982c2-358c-4c17-9dd3-87cd79983770 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:29.582510 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1fa982c2-358c-4c17-9dd3-87cd79983770 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:29.593391 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1fa982c2-358c-4c17-9dd3-87cd79983770 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:29.593887 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1fa982c2-358c-4c17-9dd3-87cd79983770 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:29.595006 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1fa982c2-358c-4c17-9dd3-87cd79983770 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:29.595623 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1fa982c2-358c-4c17-9dd3-87cd79983770 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:29.757103 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=28 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:30.042898 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1fa982c2-358c-4c17-9dd3-87cd79983770 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:30.054619 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1fa982c2-358c-4c17-9dd3-87cd79983770 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.480102 Jul 21 22:33:30.057120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 33/66] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:29 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:30.069159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f18068d4-91e6-4c1b-b74c-31f25d22724d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:30.069967 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-0546e259-daae-48db-92d7-59af5d2878d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:30.070578 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f18068d4-91e6-4c1b-b74c-31f25d22724d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:30.074137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=100 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:30.087167 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f18068d4-91e6-4c1b-b74c-31f25d22724d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:30.087899 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f18068d4-91e6-4c1b-b74c-31f25d22724d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:30.090735 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0546e259-daae-48db-92d7-59af5d2878d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 0.799850 Jul 21 22:33:30.091334 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f18068d4-91e6-4c1b-b74c-31f25d22724d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:30.091918 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 34/67] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:29 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:30.092055 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f18068d4-91e6-4c1b-b74c-31f25d22724d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:30.100017 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-20a54370-77e6-4d3c-a048-5dbbae5f5435 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:30.101021 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-20a54370-77e6-4d3c-a048-5dbbae5f5435 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:30.142295 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-20a54370-77e6-4d3c-a048-5dbbae5f5435 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:30.142955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-20a54370-77e6-4d3c-a048-5dbbae5f5435 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:30.144669 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-20a54370-77e6-4d3c-a048-5dbbae5f5435 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:30.148863 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-20a54370-77e6-4d3c-a048-5dbbae5f5435 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:30.620854 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f18068d4-91e6-4c1b-b74c-31f25d22724d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:30.630985 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f18068d4-91e6-4c1b-b74c-31f25d22724d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.567684 Jul 21 22:33:30.632430 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 34/68] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:30 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:30.678277 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-20a54370-77e6-4d3c-a048-5dbbae5f5435 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:30.697327 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-20a54370-77e6-4d3c-a048-5dbbae5f5435 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:30.699438 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-20a54370-77e6-4d3c-a048-5dbbae5f5435 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:30.700824 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-20a54370-77e6-4d3c-a048-5dbbae5f5435 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.607615 Jul 21 22:33:30.702073 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 35/69] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:30 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:31.073294 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9d960ee3-d991-4bce-9e43-5140d23bc2b9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:31.073738 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-9d960ee3-d991-4bce-9e43-5140d23bc2b9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:31.087790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:31.092061 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9d960ee3-d991-4bce-9e43-5140d23bc2b9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:31.093811 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9d960ee3-d991-4bce-9e43-5140d23bc2b9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:31.097331 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9d960ee3-d991-4bce-9e43-5140d23bc2b9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:31.098382 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9d960ee3-d991-4bce-9e43-5140d23bc2b9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:31.113280 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-dd63dee2-aea4-40e0-80c6-7fe8ccf113a6 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:31.114237 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-dd63dee2-aea4-40e0-80c6-7fe8ccf113a6 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:31.138419 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd63dee2-aea4-40e0-80c6-7fe8ccf113a6 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:31.141583 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd63dee2-aea4-40e0-80c6-7fe8ccf113a6 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:31.143269 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd63dee2-aea4-40e0-80c6-7fe8ccf113a6 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:31.147834 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd63dee2-aea4-40e0-80c6-7fe8ccf113a6 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:31.375878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-9d960ee3-d991-4bce-9e43-5140d23bc2b9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:31.390174 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-9d960ee3-d991-4bce-9e43-5140d23bc2b9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.321435 Jul 21 22:33:31.399620 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 35/70] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:31 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:31.423255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-dd63dee2-aea4-40e0-80c6-7fe8ccf113a6 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:31.434613 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-dd63dee2-aea4-40e0-80c6-7fe8ccf113a6 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 0.330645 Jul 21 22:33:31.435242 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 36/71] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:31 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:31.649206 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-37499b7b-bf82-48a7-a3e1-b8026747b7f8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:31.649810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-37499b7b-bf82-48a7-a3e1-b8026747b7f8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:31.654663 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-95be241f-73b3-46f8-9fde-4f591ac10ca6 req-e542af53-5a33-48d9-9581-1a1c81918636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdafcf28-8b2d-4692-ba35-cd63d2c32de7", "tag": "7beeb33e-b868-478b-961b-f1fcce969c8c"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:31.666552 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37499b7b-bf82-48a7-a3e1-b8026747b7f8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:31.667552 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37499b7b-bf82-48a7-a3e1-b8026747b7f8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:31.668461 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37499b7b-bf82-48a7-a3e1-b8026747b7f8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:31.668936 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37499b7b-bf82-48a7-a3e1-b8026747b7f8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:31.675112 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-95be241f-73b3-46f8-9fde-4f591ac10ca6 req-e542af53-5a33-48d9-9581-1a1c81918636 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:31.675767 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-95be241f-73b3-46f8-9fde-4f591ac10ca6 req-e542af53-5a33-48d9-9581-1a1c81918636 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:31.688194 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-95be241f-73b3-46f8-9fde-4f591ac10ca6 req-e542af53-5a33-48d9-9581-1a1c81918636 service nova] Creating event network-changed:7beeb33e-b868-478b-961b-f1fcce969c8c for instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 on hv-cinder-85069 Jul 21 22:33:31.693750 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-95be241f-73b3-46f8-9fde-4f591ac10ca6 req-e542af53-5a33-48d9-9581-1a1c81918636 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300697 Jul 21 22:33:31.694949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 36/72] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:31.721354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-aa3bc217-5370-438f-8b7e-d1600a170985 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:31.722365 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-aa3bc217-5370-438f-8b7e-d1600a170985 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:31.729816 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aa3bc217-5370-438f-8b7e-d1600a170985 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:31.730693 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aa3bc217-5370-438f-8b7e-d1600a170985 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:31.731700 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aa3bc217-5370-438f-8b7e-d1600a170985 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:31.732367 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aa3bc217-5370-438f-8b7e-d1600a170985 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:31.879720 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-37499b7b-bf82-48a7-a3e1-b8026747b7f8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:31.888384 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-37499b7b-bf82-48a7-a3e1-b8026747b7f8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.243177 Jul 21 22:33:31.888989 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 37/73] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:31 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:31.922475 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-aa3bc217-5370-438f-8b7e-d1600a170985 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:31.932001 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-aa3bc217-5370-438f-8b7e-d1600a170985 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:31.934322 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-aa3bc217-5370-438f-8b7e-d1600a170985 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:31.935625 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-aa3bc217-5370-438f-8b7e-d1600a170985 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.218916 Jul 21 22:33:31.936626 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 37/74] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:31 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:32.413811 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7c1ba240-ff78-436b-b777-9c24a89b2700 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:32.414435 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7c1ba240-ff78-436b-b777-9c24a89b2700 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:32.445118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c1ba240-ff78-436b-b777-9c24a89b2700 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:32.445574 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c1ba240-ff78-436b-b777-9c24a89b2700 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:32.446377 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c1ba240-ff78-436b-b777-9c24a89b2700 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:32.446817 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c1ba240-ff78-436b-b777-9c24a89b2700 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:32.453049 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-269462c2-f38a-4404-96e3-9416b354822f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:32.453908 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-269462c2-f38a-4404-96e3-9416b354822f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:32.463706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-269462c2-f38a-4404-96e3-9416b354822f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:32.465329 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-269462c2-f38a-4404-96e3-9416b354822f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:32.469309 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-269462c2-f38a-4404-96e3-9416b354822f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:32.469982 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-269462c2-f38a-4404-96e3-9416b354822f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:32.881521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-269462c2-f38a-4404-96e3-9416b354822f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:32.894292 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-269462c2-f38a-4404-96e3-9416b354822f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 0.446083 Jul 21 22:33:32.895608 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 38/75] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:32 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:32.918733 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4cdb34fc-d66a-44d0-af96-1f546e1a6965 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:32.921351 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4cdb34fc-d66a-44d0-af96-1f546e1a6965 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:32.923627 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7c1ba240-ff78-436b-b777-9c24a89b2700 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:32.929827 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4cdb34fc-d66a-44d0-af96-1f546e1a6965 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:32.930272 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4cdb34fc-d66a-44d0-af96-1f546e1a6965 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:32.931654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4cdb34fc-d66a-44d0-af96-1f546e1a6965 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:32.932232 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4cdb34fc-d66a-44d0-af96-1f546e1a6965 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:32.932336 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7c1ba240-ff78-436b-b777-9c24a89b2700 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.528195 Jul 21 22:33:32.942701 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 38/76] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:32 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:32.959648 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-195ef717-599a-4a62-8fc5-f8aff654e4ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:32.960659 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-195ef717-599a-4a62-8fc5-f8aff654e4ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:32.968704 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-195ef717-599a-4a62-8fc5-f8aff654e4ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:32.969590 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-195ef717-599a-4a62-8fc5-f8aff654e4ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:32.970798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-195ef717-599a-4a62-8fc5-f8aff654e4ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:32.971721 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-195ef717-599a-4a62-8fc5-f8aff654e4ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:33.275902 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4cdb34fc-d66a-44d0-af96-1f546e1a6965 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:33.282357 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-195ef717-599a-4a62-8fc5-f8aff654e4ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:33.285372 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4cdb34fc-d66a-44d0-af96-1f546e1a6965 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.377826 Jul 21 22:33:33.288439 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 39/77] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:32 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:33.295929 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-195ef717-599a-4a62-8fc5-f8aff654e4ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:33.298667 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-195ef717-599a-4a62-8fc5-f8aff654e4ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:33.300111 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-195ef717-599a-4a62-8fc5-f8aff654e4ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.344922 Jul 21 22:33:33.301240 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 39/78] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:32 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:33.912406 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-07779857-d34e-40d6-8b61-4302c1d7693a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:33.913059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-07779857-d34e-40d6-8b61-4302c1d7693a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:33.930227 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07779857-d34e-40d6-8b61-4302c1d7693a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:33.930689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07779857-d34e-40d6-8b61-4302c1d7693a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:33.931507 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07779857-d34e-40d6-8b61-4302c1d7693a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:33.931947 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07779857-d34e-40d6-8b61-4302c1d7693a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:33.949857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-57df6e57-fcda-41a9-8644-63981bff3320 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:33.950825 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-57df6e57-fcda-41a9-8644-63981bff3320 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:33.957106 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-57df6e57-fcda-41a9-8644-63981bff3320 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:33.957818 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-57df6e57-fcda-41a9-8644-63981bff3320 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:33.958800 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-57df6e57-fcda-41a9-8644-63981bff3320 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:33.959472 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-57df6e57-fcda-41a9-8644-63981bff3320 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:34.599794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-57df6e57-fcda-41a9-8644-63981bff3320 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:34.613337 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-57df6e57-fcda-41a9-8644-63981bff3320 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.667392 Jul 21 22:33:34.614331 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 40/79] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:33 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:34.619157 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a30d044b-274a-42fc-87b7-08b3b801e221 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:34.619767 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a30d044b-274a-42fc-87b7-08b3b801e221 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:34.633624 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-07779857-d34e-40d6-8b61-4302c1d7693a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:34.641393 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a30d044b-274a-42fc-87b7-08b3b801e221 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:34.641848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a30d044b-274a-42fc-87b7-08b3b801e221 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:34.642627 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a30d044b-274a-42fc-87b7-08b3b801e221 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:34.643265 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a30d044b-274a-42fc-87b7-08b3b801e221 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:34.649639 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-07779857-d34e-40d6-8b61-4302c1d7693a tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 0.739536 Jul 21 22:33:34.650690 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 40/80] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:33 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:34.660003 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-aecfc66e-6de2-4873-b57f-a910eee8fbae tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:34.660917 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-aecfc66e-6de2-4873-b57f-a910eee8fbae tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:34.679483 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aecfc66e-6de2-4873-b57f-a910eee8fbae tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:34.693073 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aecfc66e-6de2-4873-b57f-a910eee8fbae tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:34.694330 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aecfc66e-6de2-4873-b57f-a910eee8fbae tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:34.694996 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aecfc66e-6de2-4873-b57f-a910eee8fbae tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:35.224778 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a30d044b-274a-42fc-87b7-08b3b801e221 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:35.232872 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-aecfc66e-6de2-4873-b57f-a910eee8fbae tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:35.240283 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a30d044b-274a-42fc-87b7-08b3b801e221 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.624747 Jul 21 22:33:35.242392 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 41/81] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:34 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:35.252605 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-aecfc66e-6de2-4873-b57f-a910eee8fbae tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:35.254306 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-aecfc66e-6de2-4873-b57f-a910eee8fbae tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:35.255555 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-aecfc66e-6de2-4873-b57f-a910eee8fbae tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.603699 Jul 21 22:33:35.256523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 41/82] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:34 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:35.568700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-f75ef496-672f-4fdb-850a-2a0b75fd1b06 req-9cf53af2-2edf-479e-8860-c6e6fe0ae75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa905ed-e5e9-4837-8aca-77fff9f6d722", "tag": "93173e49-e7da-4add-9d87-eb54a10842e3"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:35.582780 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-f75ef496-672f-4fdb-850a-2a0b75fd1b06 req-9cf53af2-2edf-479e-8860-c6e6fe0ae75f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:35.583776 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-f75ef496-672f-4fdb-850a-2a0b75fd1b06 req-9cf53af2-2edf-479e-8860-c6e6fe0ae75f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:35.607728 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-f75ef496-672f-4fdb-850a-2a0b75fd1b06 req-9cf53af2-2edf-479e-8860-c6e6fe0ae75f service nova] Creating event network-changed:93173e49-e7da-4add-9d87-eb54a10842e3 for instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 on hv-cinder-85069 Jul 21 22:33:35.616406 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-f75ef496-672f-4fdb-850a-2a0b75fd1b06 req-9cf53af2-2edf-479e-8860-c6e6fe0ae75f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051640 Jul 21 22:33:35.617018 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 42/83] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:35.639894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f8da012d-6833-48cd-9e1b-355695a63170 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:35.639894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f8da012d-6833-48cd-9e1b-355695a63170 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:35.664685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f8da012d-6833-48cd-9e1b-355695a63170 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:35.667663 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f8da012d-6833-48cd-9e1b-355695a63170 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:35.670831 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-88572a5b-e2e4-4a14-a77d-a1c503e5a64f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:35.671611 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f8da012d-6833-48cd-9e1b-355695a63170 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:35.671797 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-88572a5b-e2e4-4a14-a77d-a1c503e5a64f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:35.673507 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f8da012d-6833-48cd-9e1b-355695a63170 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:35.681481 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-88572a5b-e2e4-4a14-a77d-a1c503e5a64f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:35.684144 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-88572a5b-e2e4-4a14-a77d-a1c503e5a64f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:35.685427 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-88572a5b-e2e4-4a14-a77d-a1c503e5a64f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:35.687808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-88572a5b-e2e4-4a14-a77d-a1c503e5a64f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:36.055257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f8da012d-6833-48cd-9e1b-355695a63170 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:36.075721 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f8da012d-6833-48cd-9e1b-355695a63170 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.438139 Jul 21 22:33:36.077098 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 42/84] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:35 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:36.089398 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-88572a5b-e2e4-4a14-a77d-a1c503e5a64f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:36.099684 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-88572a5b-e2e4-4a14-a77d-a1c503e5a64f tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 0.436698 Jul 21 22:33:36.102483 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 43/85] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:35 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:36.262707 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cd6abeb8-9283-4ef6-8bbb-5ee590088b63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:36.264308 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-cd6abeb8-9283-4ef6-8bbb-5ee590088b63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:36.278575 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-787e8ea6-ad49-4aae-b07a-12a03007d46f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:36.280314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-787e8ea6-ad49-4aae-b07a-12a03007d46f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:36.291449 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cd6abeb8-9283-4ef6-8bbb-5ee590088b63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:36.292508 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cd6abeb8-9283-4ef6-8bbb-5ee590088b63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:36.293526 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-787e8ea6-ad49-4aae-b07a-12a03007d46f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:36.294614 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cd6abeb8-9283-4ef6-8bbb-5ee590088b63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:36.295405 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-787e8ea6-ad49-4aae-b07a-12a03007d46f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:36.296469 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cd6abeb8-9283-4ef6-8bbb-5ee590088b63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:36.297948 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-787e8ea6-ad49-4aae-b07a-12a03007d46f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:36.298799 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-787e8ea6-ad49-4aae-b07a-12a03007d46f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:36.989824 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cd6abeb8-9283-4ef6-8bbb-5ee590088b63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:37.024030 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-cd6abeb8-9283-4ef6-8bbb-5ee590088b63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.761973 Jul 21 22:33:37.029885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 43/86] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:36 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:37.043609 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-787e8ea6-ad49-4aae-b07a-12a03007d46f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:37.058719 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-787e8ea6-ad49-4aae-b07a-12a03007d46f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:37.060706 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-787e8ea6-ad49-4aae-b07a-12a03007d46f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:37.064585 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-787e8ea6-ad49-4aae-b07a-12a03007d46f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.791564 Jul 21 22:33:37.071839 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 44/87] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:36 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:33:37.109290 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7aa23c53-5d06-4bf9-9189-423fe76d93b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:37.112678 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7aa23c53-5d06-4bf9-9189-423fe76d93b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:37.132405 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2447dec5-6437-4728-9e56-f59f17bdbd1e tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:37.133483 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2447dec5-6437-4728-9e56-f59f17bdbd1e tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:37.143415 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7aa23c53-5d06-4bf9-9189-423fe76d93b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:37.144911 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2447dec5-6437-4728-9e56-f59f17bdbd1e tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:37.145329 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7aa23c53-5d06-4bf9-9189-423fe76d93b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:37.147469 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2447dec5-6437-4728-9e56-f59f17bdbd1e tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:37.148983 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2447dec5-6437-4728-9e56-f59f17bdbd1e tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:37.149920 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2447dec5-6437-4728-9e56-f59f17bdbd1e tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:37.150159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7aa23c53-5d06-4bf9-9189-423fe76d93b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:37.153701 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7aa23c53-5d06-4bf9-9189-423fe76d93b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:37.204037 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=4 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:38.342799 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-2447dec5-6437-4728-9e56-f59f17bdbd1e tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:38.387031 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2447dec5-6437-4728-9e56-f59f17bdbd1e tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 1.250449 Jul 21 22:33:38.399149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 45/88] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:37 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:38.420664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-db8d7675-50b8-45e3-bc92-222327553b61 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:38.423032 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-db8d7675-50b8-45e3-bc92-222327553b61 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:38.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-db8d7675-50b8-45e3-bc92-222327553b61 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:38.453262 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-db8d7675-50b8-45e3-bc92-222327553b61 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:38.454032 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-db8d7675-50b8-45e3-bc92-222327553b61 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:38.454478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-db8d7675-50b8-45e3-bc92-222327553b61 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:38.537295 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7aa23c53-5d06-4bf9-9189-423fe76d93b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:38.563787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7aa23c53-5d06-4bf9-9189-423fe76d93b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 1.466001 Jul 21 22:33:38.566018 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 44/89] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:37 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:38.587868 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-65dc0f2a-21e6-4bd2-ac91-f54d35373f6f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:38.594453 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-65dc0f2a-21e6-4bd2-ac91-f54d35373f6f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:38.615855 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65dc0f2a-21e6-4bd2-ac91-f54d35373f6f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:38.616547 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65dc0f2a-21e6-4bd2-ac91-f54d35373f6f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:38.621682 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65dc0f2a-21e6-4bd2-ac91-f54d35373f6f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:38.623326 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65dc0f2a-21e6-4bd2-ac91-f54d35373f6f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:39.091846 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-db8d7675-50b8-45e3-bc92-222327553b61 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:39.107990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-db8d7675-50b8-45e3-bc92-222327553b61 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.711920 Jul 21 22:33:39.127787 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 46/90] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:38 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:39.353822 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-65dc0f2a-21e6-4bd2-ac91-f54d35373f6f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:39.374123 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-65dc0f2a-21e6-4bd2-ac91-f54d35373f6f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:39.395452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-65dc0f2a-21e6-4bd2-ac91-f54d35373f6f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:39.398699 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-65dc0f2a-21e6-4bd2-ac91-f54d35373f6f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.830779 Jul 21 22:33:39.400210 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 45/91] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:38 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:39.425817 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-184670d6-b7d9-4777-bbb3-373248a1f393 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:39.429205 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-184670d6-b7d9-4777-bbb3-373248a1f393 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:39.457452 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-184670d6-b7d9-4777-bbb3-373248a1f393 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:39.458279 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-184670d6-b7d9-4777-bbb3-373248a1f393 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:39.462455 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-184670d6-b7d9-4777-bbb3-373248a1f393 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:39.465236 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-184670d6-b7d9-4777-bbb3-373248a1f393 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:39.596928 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e9b4c7ad-5b47-473d-bc88-3932e4e71906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:39.602776 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e9b4c7ad-5b47-473d-bc88-3932e4e71906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:39.608450 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:39.622988 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e9b4c7ad-5b47-473d-bc88-3932e4e71906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:39.624352 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e9b4c7ad-5b47-473d-bc88-3932e4e71906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:39.626030 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e9b4c7ad-5b47-473d-bc88-3932e4e71906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:39.626789 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e9b4c7ad-5b47-473d-bc88-3932e4e71906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:39.847074 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-184670d6-b7d9-4777-bbb3-373248a1f393 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:39.863146 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-184670d6-b7d9-4777-bbb3-373248a1f393 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 0.446887 Jul 21 22:33:39.865469 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 47/92] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:39 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:39.950231 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e9b4c7ad-5b47-473d-bc88-3932e4e71906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:39.959474 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e9b4c7ad-5b47-473d-bc88-3932e4e71906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.371906 Jul 21 22:33:39.960746 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 46/93] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:39 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:40.143032 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6cfe0bf5-35dd-45a4-bcb1-b166a2ca41dc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:40.144606 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-6cfe0bf5-35dd-45a4-bcb1-b166a2ca41dc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:40.157107 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6cfe0bf5-35dd-45a4-bcb1-b166a2ca41dc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:40.158550 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6cfe0bf5-35dd-45a4-bcb1-b166a2ca41dc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:40.160438 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6cfe0bf5-35dd-45a4-bcb1-b166a2ca41dc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:40.161670 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6cfe0bf5-35dd-45a4-bcb1-b166a2ca41dc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:40.427327 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7f32005a-237e-496e-a4e2-857e5dd2af5b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:40.432826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7f32005a-237e-496e-a4e2-857e5dd2af5b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:40.458500 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7f32005a-237e-496e-a4e2-857e5dd2af5b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:40.459474 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7f32005a-237e-496e-a4e2-857e5dd2af5b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:40.460469 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7f32005a-237e-496e-a4e2-857e5dd2af5b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:40.461105 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7f32005a-237e-496e-a4e2-857e5dd2af5b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:40.576370 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6cfe0bf5-35dd-45a4-bcb1-b166a2ca41dc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:40.592130 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6cfe0bf5-35dd-45a4-bcb1-b166a2ca41dc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.457023 Jul 21 22:33:40.610144 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 48/94] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:40 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:40.820727 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7f32005a-237e-496e-a4e2-857e5dd2af5b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:40.843558 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7f32005a-237e-496e-a4e2-857e5dd2af5b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:40.847752 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7f32005a-237e-496e-a4e2-857e5dd2af5b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:40.850388 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7f32005a-237e-496e-a4e2-857e5dd2af5b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.431333 Jul 21 22:33:40.866397 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 47/95] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:40 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:40.881776 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-511220b3-fd1f-419b-bae1-a78a3fff7222 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:40.882387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-511220b3-fd1f-419b-bae1-a78a3fff7222 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:40.891952 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-511220b3-fd1f-419b-bae1-a78a3fff7222 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:40.892373 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-511220b3-fd1f-419b-bae1-a78a3fff7222 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:40.894550 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-511220b3-fd1f-419b-bae1-a78a3fff7222 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:40.895820 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-511220b3-fd1f-419b-bae1-a78a3fff7222 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:40.979907 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f9e8832a-68a3-4324-96d2-9f4b1cda8b42 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:40.980946 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f9e8832a-68a3-4324-96d2-9f4b1cda8b42 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:40.992849 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9e8832a-68a3-4324-96d2-9f4b1cda8b42 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:40.995084 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9e8832a-68a3-4324-96d2-9f4b1cda8b42 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:40.999086 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9e8832a-68a3-4324-96d2-9f4b1cda8b42 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:41.011243 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9e8832a-68a3-4324-96d2-9f4b1cda8b42 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:41.059863 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=100 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:41.293146 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-511220b3-fd1f-419b-bae1-a78a3fff7222 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:41.304783 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-511220b3-fd1f-419b-bae1-a78a3fff7222 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 0.426741 Jul 21 22:33:41.316710 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 49/96] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:40 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:41.347124 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f9e8832a-68a3-4324-96d2-9f4b1cda8b42 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:41.359632 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f9e8832a-68a3-4324-96d2-9f4b1cda8b42 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.383672 Jul 21 22:33:41.361072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 48/97] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:40 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:41.617757 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8696a442-335f-4c52-9f5c-e9cd72208fa9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:41.618409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-8696a442-335f-4c52-9f5c-e9cd72208fa9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:41.626364 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8696a442-335f-4c52-9f5c-e9cd72208fa9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:41.626864 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8696a442-335f-4c52-9f5c-e9cd72208fa9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:41.627953 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8696a442-335f-4c52-9f5c-e9cd72208fa9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:41.628881 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8696a442-335f-4c52-9f5c-e9cd72208fa9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:41.821245 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8696a442-335f-4c52-9f5c-e9cd72208fa9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:41.833898 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8696a442-335f-4c52-9f5c-e9cd72208fa9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.220317 Jul 21 22:33:41.835502 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 50/98] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:41 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:41.874728 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-76235745-2abe-4aa3-b0be-f8f6e82e228b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:41.875365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-76235745-2abe-4aa3-b0be-f8f6e82e228b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:41.883388 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76235745-2abe-4aa3-b0be-f8f6e82e228b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:41.884218 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76235745-2abe-4aa3-b0be-f8f6e82e228b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:41.887600 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76235745-2abe-4aa3-b0be-f8f6e82e228b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:41.888040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76235745-2abe-4aa3-b0be-f8f6e82e228b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:42.006039 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-d1e99e9d-d3ad-4428-af3f-aa357a4a5ceb req-737fa0bd-7b74-4626-82c2-ee81c787a936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d2d5c65-369e-40c5-9218-9be17b9bf09b", "name": "network-vif-plugged", "status": "completed", "tag": "a9c8cd4d-fcdb-4161-9b9c-20c9deff216d"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:42.019225 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-d1e99e9d-d3ad-4428-af3f-aa357a4a5ceb req-737fa0bd-7b74-4626-82c2-ee81c787a936 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:42.020343 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-d1e99e9d-d3ad-4428-af3f-aa357a4a5ceb req-737fa0bd-7b74-4626-82c2-ee81c787a936 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:42.038919 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-d1e99e9d-d3ad-4428-af3f-aa357a4a5ceb req-737fa0bd-7b74-4626-82c2-ee81c787a936 service nova] Creating event network-vif-plugged:a9c8cd4d-fcdb-4161-9b9c-20c9deff216d for instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b on hv-cinder-85069 Jul 21 22:33:42.048374 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-76235745-2abe-4aa3-b0be-f8f6e82e228b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:42.048929 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-d1e99e9d-d3ad-4428-af3f-aa357a4a5ceb req-737fa0bd-7b74-4626-82c2-ee81c787a936 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374301 Jul 21 22:33:42.050422 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 49/99] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:42.059000 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-76235745-2abe-4aa3-b0be-f8f6e82e228b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:42.060734 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-76235745-2abe-4aa3-b0be-f8f6e82e228b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:42.061985 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-76235745-2abe-4aa3-b0be-f8f6e82e228b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.192200 Jul 21 22:33:42.063129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 51/100] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:41 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:33:42.335764 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-be2a4730-017e-4edc-83cf-3e613a879922 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:42.336537 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-be2a4730-017e-4edc-83cf-3e613a879922 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:42.353087 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-be2a4730-017e-4edc-83cf-3e613a879922 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:42.353833 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-be2a4730-017e-4edc-83cf-3e613a879922 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:42.355824 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-be2a4730-017e-4edc-83cf-3e613a879922 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:42.356552 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-be2a4730-017e-4edc-83cf-3e613a879922 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:42.391978 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-457e1cd1-1c68-45b1-b32e-f84484c61cfc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:42.395212 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-457e1cd1-1c68-45b1-b32e-f84484c61cfc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:42.419319 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-457e1cd1-1c68-45b1-b32e-f84484c61cfc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:42.424296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-457e1cd1-1c68-45b1-b32e-f84484c61cfc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:42.442475 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-457e1cd1-1c68-45b1-b32e-f84484c61cfc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:42.443737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-457e1cd1-1c68-45b1-b32e-f84484c61cfc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:42.520218 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=100 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:42.928855 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-be2a4730-017e-4edc-83cf-3e613a879922 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:42.961119 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-be2a4730-017e-4edc-83cf-3e613a879922 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 0.640459 Jul 21 22:33:42.962657 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 50/101] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:42 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:42.972242 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3b373e76-8b1a-4107-a5a6-8f6676697f63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:42.973850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3b373e76-8b1a-4107-a5a6-8f6676697f63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:42.985034 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b373e76-8b1a-4107-a5a6-8f6676697f63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:42.986284 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b373e76-8b1a-4107-a5a6-8f6676697f63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:42.988756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b373e76-8b1a-4107-a5a6-8f6676697f63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:42.989524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b373e76-8b1a-4107-a5a6-8f6676697f63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:43.238327 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-457e1cd1-1c68-45b1-b32e-f84484c61cfc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:43.258497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-457e1cd1-1c68-45b1-b32e-f84484c61cfc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.868215 Jul 21 22:33:43.263220 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 52/102] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:42 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:43.284107 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e33e9963-9a89-4d78-9b37-ac88374917d1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:43.287827 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e33e9963-9a89-4d78-9b37-ac88374917d1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:43.321886 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e33e9963-9a89-4d78-9b37-ac88374917d1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:43.325456 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e33e9963-9a89-4d78-9b37-ac88374917d1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:43.329580 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e33e9963-9a89-4d78-9b37-ac88374917d1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:43.334343 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e33e9963-9a89-4d78-9b37-ac88374917d1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:43.427781 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3b373e76-8b1a-4107-a5a6-8f6676697f63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:43.443654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3b373e76-8b1a-4107-a5a6-8f6676697f63 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.476708 Jul 21 22:33:43.463239 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 51/103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:42 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:43.725318 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e33e9963-9a89-4d78-9b37-ac88374917d1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:43.770865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e33e9963-9a89-4d78-9b37-ac88374917d1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:43.783036 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e33e9963-9a89-4d78-9b37-ac88374917d1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:43.786503 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e33e9963-9a89-4d78-9b37-ac88374917d1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.521689 Jul 21 22:33:43.788523 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 53/104] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:43 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:43.988116 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e7fa2dc9-111a-4b28-a208-1c1183a60079 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:43.988749 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e7fa2dc9-111a-4b28-a208-1c1183a60079 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:43.998701 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e7fa2dc9-111a-4b28-a208-1c1183a60079 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:43.999611 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e7fa2dc9-111a-4b28-a208-1c1183a60079 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.000601 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e7fa2dc9-111a-4b28-a208-1c1183a60079 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:44.001207 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e7fa2dc9-111a-4b28-a208-1c1183a60079 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.065869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-c7773467-6322-4004-8909-10a6294df46d req-75115fdb-6298-4b5c-b4a6-81747b8ed6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967535ed-7748-4181-a946-d67bfbb813d0", "name": "network-vif-plugged", "status": "completed", "tag": "a64b5308-fbc3-42f2-a21e-3de790b55a40"}, {"server_uuid": "2256ebb9-3077-4700-bdc1-bdfd57d082a5", "name": "network-vif-plugged", "status": "completed", "tag": "9d9b621d-5324-47aa-be89-af4177fdd319"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:44.083427 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-c7773467-6322-4004-8909-10a6294df46d req-75115fdb-6298-4b5c-b4a6-81747b8ed6af service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:44.083921 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-c7773467-6322-4004-8909-10a6294df46d req-75115fdb-6298-4b5c-b4a6-81747b8ed6af service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.125904 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-c7773467-6322-4004-8909-10a6294df46d req-75115fdb-6298-4b5c-b4a6-81747b8ed6af service nova] Creating event network-vif-plugged:a64b5308-fbc3-42f2-a21e-3de790b55a40 for instance 967535ed-7748-4181-a946-d67bfbb813d0 on hv-cinder-85069 Jul 21 22:33:44.129965 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-c7773467-6322-4004-8909-10a6294df46d req-75115fdb-6298-4b5c-b4a6-81747b8ed6af service nova] Creating event network-vif-plugged:9d9b621d-5324-47aa-be89-af4177fdd319 for instance 2256ebb9-3077-4700-bdc1-bdfd57d082a5 on hv-cinder-85069 Jul 21 22:33:44.149154 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-c7773467-6322-4004-8909-10a6294df46d req-75115fdb-6298-4b5c-b4a6-81747b8ed6af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086471 Jul 21 22:33:44.153680 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 54/105] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:33:44.280214 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-ab41ddd3-023c-4d06-9a10-faa1c0235882 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:44.280972 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-ab41ddd3-023c-4d06-9a10-faa1c0235882 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:44.300776 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ab41ddd3-023c-4d06-9a10-faa1c0235882 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:44.305140 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ab41ddd3-023c-4d06-9a10-faa1c0235882 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.307749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ab41ddd3-023c-4d06-9a10-faa1c0235882 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:44.321958 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ab41ddd3-023c-4d06-9a10-faa1c0235882 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.513463 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e7fa2dc9-111a-4b28-a208-1c1183a60079 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:44.533523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e7fa2dc9-111a-4b28-a208-1c1183a60079 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1315 microversion: 2.1 time: 0.550621 Jul 21 22:33:44.536383 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 52/106] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:43 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:44.550386 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f60f033e-d7b9-41fc-b2e4-19c7aa6ccc7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:44.560268 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f60f033e-d7b9-41fc-b2e4-19c7aa6ccc7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:44.584999 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f60f033e-d7b9-41fc-b2e4-19c7aa6ccc7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:44.586391 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f60f033e-d7b9-41fc-b2e4-19c7aa6ccc7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.591853 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f60f033e-d7b9-41fc-b2e4-19c7aa6ccc7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:44.592505 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f60f033e-d7b9-41fc-b2e4-19c7aa6ccc7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.872271 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-ab41ddd3-023c-4d06-9a10-faa1c0235882 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:44.882192 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-ab41ddd3-023c-4d06-9a10-faa1c0235882 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.607813 Jul 21 22:33:44.892396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 55/107] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:44 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:44.900504 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0ee0dbc7-0d22-4ee5-9af5-391da193de11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:44.901733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0ee0dbc7-0d22-4ee5-9af5-391da193de11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:44.919866 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0ee0dbc7-0d22-4ee5-9af5-391da193de11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:44.921312 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0ee0dbc7-0d22-4ee5-9af5-391da193de11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.922636 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0ee0dbc7-0d22-4ee5-9af5-391da193de11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:44.923348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0ee0dbc7-0d22-4ee5-9af5-391da193de11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.997071 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f60f033e-d7b9-41fc-b2e4-19c7aa6ccc7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:45.016888 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f60f033e-d7b9-41fc-b2e4-19c7aa6ccc7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.475425 Jul 21 22:33:45.017537 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 53/108] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:44 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:45.145671 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-0ee0dbc7-0d22-4ee5-9af5-391da193de11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:45.156410 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-0ee0dbc7-0d22-4ee5-9af5-391da193de11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:45.158361 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-0ee0dbc7-0d22-4ee5-9af5-391da193de11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:45.159698 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0ee0dbc7-0d22-4ee5-9af5-391da193de11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.267121 Jul 21 22:33:45.160298 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 56/109] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:44 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:45.564964 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-51663267-98fa-442b-a44e-70786b18958c tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:45.568833 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-51663267-98fa-442b-a44e-70786b18958c tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:45.581234 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-51663267-98fa-442b-a44e-70786b18958c tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:45.581689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-51663267-98fa-442b-a44e-70786b18958c tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:45.582581 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-51663267-98fa-442b-a44e-70786b18958c tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:45.583113 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-51663267-98fa-442b-a44e-70786b18958c tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:45.865154 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-51663267-98fa-442b-a44e-70786b18958c tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:45.889935 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-51663267-98fa-442b-a44e-70786b18958c tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1503 microversion: 2.1 time: 0.330391 Jul 21 22:33:45.931546 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 54/110] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:45 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1503 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:45.932001 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9fc34a14-6af2-42b3-bbd8-7634dfa6853a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:45.934694 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-9fc34a14-6af2-42b3-bbd8-7634dfa6853a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:45.949843 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9fc34a14-6af2-42b3-bbd8-7634dfa6853a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:45.951020 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9fc34a14-6af2-42b3-bbd8-7634dfa6853a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:45.952868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9fc34a14-6af2-42b3-bbd8-7634dfa6853a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:45.954056 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9fc34a14-6af2-42b3-bbd8-7634dfa6853a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:46.054350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7ca6fad0-c7f1-459d-8d5d-3f537393f571 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:46.055438 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7ca6fad0-c7f1-459d-8d5d-3f537393f571 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:46.074000 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ca6fad0-c7f1-459d-8d5d-3f537393f571 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:46.075903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ca6fad0-c7f1-459d-8d5d-3f537393f571 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:46.077926 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ca6fad0-c7f1-459d-8d5d-3f537393f571 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:46.079471 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ca6fad0-c7f1-459d-8d5d-3f537393f571 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:46.350676 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-9fc34a14-6af2-42b3-bbd8-7634dfa6853a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:46.373661 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-9fc34a14-6af2-42b3-bbd8-7634dfa6853a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1322 microversion: 2.1 time: 0.466974 Jul 21 22:33:46.376672 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 57/111] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:45 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:46.399891 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a5a6e31f-96a1-4684-9f47-b8b8acf2ebec tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:46.402228 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a5a6e31f-96a1-4684-9f47-b8b8acf2ebec tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:46.422593 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a5a6e31f-96a1-4684-9f47-b8b8acf2ebec tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:46.423785 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a5a6e31f-96a1-4684-9f47-b8b8acf2ebec tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:46.426548 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a5a6e31f-96a1-4684-9f47-b8b8acf2ebec tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:46.427975 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a5a6e31f-96a1-4684-9f47-b8b8acf2ebec tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:46.431822 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7ca6fad0-c7f1-459d-8d5d-3f537393f571 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:46.452347 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7ca6fad0-c7f1-459d-8d5d-3f537393f571 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.407320 Jul 21 22:33:46.463331 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 55/112] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:46 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:46.916801 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a5a6e31f-96a1-4684-9f47-b8b8acf2ebec tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:46.946437 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a5a6e31f-96a1-4684-9f47-b8b8acf2ebec tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:46.966066 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a5a6e31f-96a1-4684-9f47-b8b8acf2ebec tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:46.966066 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a5a6e31f-96a1-4684-9f47-b8b8acf2ebec tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.581412 Jul 21 22:33:46.987090 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 58/113] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:46 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:47.083698 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-8cf20487-4484-4086-8bdc-21d6ac36660d req-343062ed-863c-4c30-b59b-211535465333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa905ed-e5e9-4837-8aca-77fff9f6d722", "name": "network-vif-plugged", "status": "completed", "tag": "93173e49-e7da-4add-9d87-eb54a10842e3"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:47.097228 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-8cf20487-4484-4086-8bdc-21d6ac36660d req-343062ed-863c-4c30-b59b-211535465333 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:47.097679 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-8cf20487-4484-4086-8bdc-21d6ac36660d req-343062ed-863c-4c30-b59b-211535465333 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:47.139112 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-8cf20487-4484-4086-8bdc-21d6ac36660d req-343062ed-863c-4c30-b59b-211535465333 service nova] Creating event network-vif-plugged:93173e49-e7da-4add-9d87-eb54a10842e3 for instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 on hv-cinder-85069 Jul 21 22:33:47.139112 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-8cf20487-4484-4086-8bdc-21d6ac36660d req-343062ed-863c-4c30-b59b-211535465333 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058181 Jul 21 22:33:47.140494 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 56/114] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:47.405677 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b6e22a74-2e55-4be5-90bd-a7f6603acca1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:47.406520 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b6e22a74-2e55-4be5-90bd-a7f6603acca1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:47.422126 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b6e22a74-2e55-4be5-90bd-a7f6603acca1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:47.422990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b6e22a74-2e55-4be5-90bd-a7f6603acca1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:47.424125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b6e22a74-2e55-4be5-90bd-a7f6603acca1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:47.426323 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b6e22a74-2e55-4be5-90bd-a7f6603acca1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:47.481937 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5d529de8-ca2f-4bd1-be30-a2fcc5c6ea01 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:47.483193 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-5d529de8-ca2f-4bd1-be30-a2fcc5c6ea01 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:47.498705 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d529de8-ca2f-4bd1-be30-a2fcc5c6ea01 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:47.499199 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d529de8-ca2f-4bd1-be30-a2fcc5c6ea01 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:47.500746 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d529de8-ca2f-4bd1-be30-a2fcc5c6ea01 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:47.501968 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d529de8-ca2f-4bd1-be30-a2fcc5c6ea01 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:47.779690 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b6e22a74-2e55-4be5-90bd-a7f6603acca1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:47.790170 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b6e22a74-2e55-4be5-90bd-a7f6603acca1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1516 microversion: 2.1 time: 0.392695 Jul 21 22:33:47.796336 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 59/115] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:47 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1516 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:47.827948 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-78cea84b-f841-4c98-ac61-7b47ea9b6bd2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:47.828928 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-78cea84b-f841-4c98-ac61-7b47ea9b6bd2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:47.845219 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-78cea84b-f841-4c98-ac61-7b47ea9b6bd2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:47.848514 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-78cea84b-f841-4c98-ac61-7b47ea9b6bd2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:47.850341 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-78cea84b-f841-4c98-ac61-7b47ea9b6bd2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:47.852580 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-78cea84b-f841-4c98-ac61-7b47ea9b6bd2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:47.887818 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5d529de8-ca2f-4bd1-be30-a2fcc5c6ea01 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:47.904556 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5d529de8-ca2f-4bd1-be30-a2fcc5c6ea01 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.426917 Jul 21 22:33:47.906301 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 57/116] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:47 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:48.002749 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-68951caa-cda3-4c33-b52c-6ee16d185c24 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:48.007710 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-68951caa-cda3-4c33-b52c-6ee16d185c24 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:48.017668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-78cea84b-f841-4c98-ac61-7b47ea9b6bd2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lazy-loading 'flavor' on Instance uuid 2256ebb9-3077-4700-bdc1-bdfd57d082a5 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:33:48.018620 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-68951caa-cda3-4c33-b52c-6ee16d185c24 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:48.018789 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-68951caa-cda3-4c33-b52c-6ee16d185c24 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:48.019677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-68951caa-cda3-4c33-b52c-6ee16d185c24 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:48.022274 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-68951caa-cda3-4c33-b52c-6ee16d185c24 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:48.375439 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-78cea84b-f841-4c98-ac61-7b47ea9b6bd2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "POST /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5/action" status: 200 len: 32 microversion: 2.1 time: 0.552356 Jul 21 22:33:48.383267 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 60/117] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:33:47 2022] POST /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5/action => generated 32 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:33:48.397275 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-68951caa-cda3-4c33-b52c-6ee16d185c24 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:48.409437 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-33b49a5b-3fc2-410a-b790-e107ef8f6921 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18f993ff-67fb-4c7e-95e4-0ec0ad7c852c"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:48.412733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-33b49a5b-3fc2-410a-b790-e107ef8f6921 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:48.424615 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-68951caa-cda3-4c33-b52c-6ee16d185c24 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:48.427614 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-68951caa-cda3-4c33-b52c-6ee16d185c24 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:48.428849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-33b49a5b-3fc2-410a-b790-e107ef8f6921 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:48.429301 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-33b49a5b-3fc2-410a-b790-e107ef8f6921 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:48.429826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-68951caa-cda3-4c33-b52c-6ee16d185c24 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.438183 Jul 21 22:33:48.430093 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-33b49a5b-3fc2-410a-b790-e107ef8f6921 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:48.431090 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 58/118] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:47 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:48.433727 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-33b49a5b-3fc2-410a-b790-e107ef8f6921 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:48.437386 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1ab78804-1cec-458d-8b14-f7ccbf775e4f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:48.438325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1ab78804-1cec-458d-8b14-f7ccbf775e4f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:48.457605 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1ab78804-1cec-458d-8b14-f7ccbf775e4f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:48.458300 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1ab78804-1cec-458d-8b14-f7ccbf775e4f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:48.459654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1ab78804-1cec-458d-8b14-f7ccbf775e4f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:48.461039 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1ab78804-1cec-458d-8b14-f7ccbf775e4f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:49.121521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1ab78804-1cec-458d-8b14-f7ccbf775e4f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:49.139953 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1ab78804-1cec-458d-8b14-f7ccbf775e4f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.706875 Jul 21 22:33:49.140252 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 59/119] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:48 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:49.145793 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-23e0509c-e12d-452e-89c7-188c0fbb72d3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:49.146660 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-23e0509c-e12d-452e-89c7-188c0fbb72d3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:49.156494 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-23e0509c-e12d-452e-89c7-188c0fbb72d3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:49.156805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-23e0509c-e12d-452e-89c7-188c0fbb72d3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:49.157782 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-23e0509c-e12d-452e-89c7-188c0fbb72d3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:49.158369 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-23e0509c-e12d-452e-89c7-188c0fbb72d3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:49.210992 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-33b49a5b-3fc2-410a-b790-e107ef8f6921 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "POST /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831769 Jul 21 22:33:49.212732 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 61/120] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:33:48 2022] POST /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b/os-volume_attachments => generated 194 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:49.225591 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-a7b87946-b04c-4629-925b-b6a6c1ea22b9 req-89bd1b76-2116-47c6-a608-7a9cc6cea5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdafcf28-8b2d-4692-ba35-cd63d2c32de7", "name": "network-vif-plugged", "status": "completed", "tag": "7beeb33e-b868-478b-961b-f1fcce969c8c"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:49.251961 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-a7b87946-b04c-4629-925b-b6a6c1ea22b9 req-89bd1b76-2116-47c6-a608-7a9cc6cea5b3 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:49.257048 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-a7b87946-b04c-4629-925b-b6a6c1ea22b9 req-89bd1b76-2116-47c6-a608-7a9cc6cea5b3 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:49.304400 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-a7b87946-b04c-4629-925b-b6a6c1ea22b9 req-89bd1b76-2116-47c6-a608-7a9cc6cea5b3 service nova] Creating event network-vif-plugged:7beeb33e-b868-478b-961b-f1fcce969c8c for instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 on hv-cinder-85069 Jul 21 22:33:49.320788 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-a7b87946-b04c-4629-925b-b6a6c1ea22b9 req-89bd1b76-2116-47c6-a608-7a9cc6cea5b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104874 Jul 21 22:33:49.323888 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 62/121] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:49.427612 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-23e0509c-e12d-452e-89c7-188c0fbb72d3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:49.439959 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-23e0509c-e12d-452e-89c7-188c0fbb72d3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.298306 Jul 21 22:33:49.440587 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 60/122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:49 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:49.464789 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-10e1e5e8-dfab-41cd-9043-2c503cb4c4f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:49.465743 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-10e1e5e8-dfab-41cd-9043-2c503cb4c4f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:49.479379 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-10e1e5e8-dfab-41cd-9043-2c503cb4c4f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:49.480637 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-10e1e5e8-dfab-41cd-9043-2c503cb4c4f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:49.481532 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-10e1e5e8-dfab-41cd-9043-2c503cb4c4f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:49.481986 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-10e1e5e8-dfab-41cd-9043-2c503cb4c4f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:49.724855 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-10e1e5e8-dfab-41cd-9043-2c503cb4c4f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:49.736004 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-10e1e5e8-dfab-41cd-9043-2c503cb4c4f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:49.737769 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-10e1e5e8-dfab-41cd-9043-2c503cb4c4f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:49.739095 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-10e1e5e8-dfab-41cd-9043-2c503cb4c4f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.282390 Jul 21 22:33:49.739718 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 63/123] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:49 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:33:50.168313 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3087efd4-cba7-421f-884c-327c7e6d7540 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:50.168917 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3087efd4-cba7-421f-884c-327c7e6d7540 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:50.181539 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3087efd4-cba7-421f-884c-327c7e6d7540 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:50.183117 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3087efd4-cba7-421f-884c-327c7e6d7540 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:50.184876 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3087efd4-cba7-421f-884c-327c7e6d7540 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:50.187476 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3087efd4-cba7-421f-884c-327c7e6d7540 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:50.458740 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-940526b7-8f26-45ee-ab44-dc086e7b2c90 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:50.460162 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-940526b7-8f26-45ee-ab44-dc086e7b2c90 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:50.471904 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3087efd4-cba7-421f-884c-327c7e6d7540 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:50.493938 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-940526b7-8f26-45ee-ab44-dc086e7b2c90 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:50.497336 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3087efd4-cba7-421f-884c-327c7e6d7540 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.332714 Jul 21 22:33:50.499214 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-940526b7-8f26-45ee-ab44-dc086e7b2c90 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:50.500169 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 61/124] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:50 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:50.503917 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-940526b7-8f26-45ee-ab44-dc086e7b2c90 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:50.504459 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-940526b7-8f26-45ee-ab44-dc086e7b2c90 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:50.764717 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8870bd5d-72b8-422f-b381-abc1823c332e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:50.765735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8870bd5d-72b8-422f-b381-abc1823c332e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:50.782677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8870bd5d-72b8-422f-b381-abc1823c332e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:50.784089 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8870bd5d-72b8-422f-b381-abc1823c332e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:50.787213 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8870bd5d-72b8-422f-b381-abc1823c332e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:50.788905 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8870bd5d-72b8-422f-b381-abc1823c332e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:51.073653 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-940526b7-8f26-45ee-ab44-dc086e7b2c90 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:51.098303 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-940526b7-8f26-45ee-ab44-dc086e7b2c90 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.643770 Jul 21 22:33:51.101884 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 64/125] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:50 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:51.203099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8870bd5d-72b8-422f-b381-abc1823c332e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:51.221528 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8870bd5d-72b8-422f-b381-abc1823c332e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:51.224323 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8870bd5d-72b8-422f-b381-abc1823c332e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:51.225788 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8870bd5d-72b8-422f-b381-abc1823c332e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.468868 Jul 21 22:33:51.226811 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 62/126] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:50 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:33:51.531594 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a615d515-8e67-47d2-8b71-0ce3fca353c8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:51.533885 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a615d515-8e67-47d2-8b71-0ce3fca353c8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:51.553256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a615d515-8e67-47d2-8b71-0ce3fca353c8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:51.554542 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a615d515-8e67-47d2-8b71-0ce3fca353c8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:51.556292 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a615d515-8e67-47d2-8b71-0ce3fca353c8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:51.558442 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a615d515-8e67-47d2-8b71-0ce3fca353c8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:51.908043 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a615d515-8e67-47d2-8b71-0ce3fca353c8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:51.922304 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a615d515-8e67-47d2-8b71-0ce3fca353c8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.398555 Jul 21 22:33:51.923377 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 65/127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:51 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:52.126966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-320ff7f8-f000-4e29-b80d-0118e774a40c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:52.128115 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-320ff7f8-f000-4e29-b80d-0118e774a40c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:52.141572 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-320ff7f8-f000-4e29-b80d-0118e774a40c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:52.143331 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-320ff7f8-f000-4e29-b80d-0118e774a40c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:52.146559 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-320ff7f8-f000-4e29-b80d-0118e774a40c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:52.148505 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-320ff7f8-f000-4e29-b80d-0118e774a40c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:52.257461 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-06c7d1f0-3d26-4e7b-89ca-9c41580952bb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:52.258537 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-06c7d1f0-3d26-4e7b-89ca-9c41580952bb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:52.308562 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06c7d1f0-3d26-4e7b-89ca-9c41580952bb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:52.310234 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06c7d1f0-3d26-4e7b-89ca-9c41580952bb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:52.327756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06c7d1f0-3d26-4e7b-89ca-9c41580952bb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:52.327756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06c7d1f0-3d26-4e7b-89ca-9c41580952bb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:52.585545 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-320ff7f8-f000-4e29-b80d-0118e774a40c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:52.599897 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-06c7d1f0-3d26-4e7b-89ca-9c41580952bb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:52.609536 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:52.625581 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-320ff7f8-f000-4e29-b80d-0118e774a40c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1363 microversion: 2.1 time: 0.509930 Jul 21 22:33:52.630789 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 63/128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:52 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1363 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:52.640133 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-06c7d1f0-3d26-4e7b-89ca-9c41580952bb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:52.643863 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-06c7d1f0-3d26-4e7b-89ca-9c41580952bb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:52.647142 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-06c7d1f0-3d26-4e7b-89ca-9c41580952bb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.397805 Jul 21 22:33:52.649530 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 66/129] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:52 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:52.942139 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8179be60-4190-4707-bcac-a121351287dc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:52.942812 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8179be60-4190-4707-bcac-a121351287dc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:52.949271 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8179be60-4190-4707-bcac-a121351287dc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:52.949719 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8179be60-4190-4707-bcac-a121351287dc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:52.950573 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8179be60-4190-4707-bcac-a121351287dc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:52.951010 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8179be60-4190-4707-bcac-a121351287dc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:53.131459 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8179be60-4190-4707-bcac-a121351287dc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:53.149003 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8179be60-4190-4707-bcac-a121351287dc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.211074 Jul 21 22:33:53.151665 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 64/130] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:52 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:53.658852 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-805d58e5-cb75-45b3-8164-5744735b9e0b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:53.660120 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-805d58e5-cb75-45b3-8164-5744735b9e0b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:53.670829 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-805d58e5-cb75-45b3-8164-5744735b9e0b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:53.676891 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-805d58e5-cb75-45b3-8164-5744735b9e0b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:53.679592 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-805d58e5-cb75-45b3-8164-5744735b9e0b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:53.681644 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-805d58e5-cb75-45b3-8164-5744735b9e0b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:53.698370 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-66bb094e-b81e-4cdd-8e8e-46af21b94b5e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:53.701131 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-66bb094e-b81e-4cdd-8e8e-46af21b94b5e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:53.719913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66bb094e-b81e-4cdd-8e8e-46af21b94b5e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:53.721091 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66bb094e-b81e-4cdd-8e8e-46af21b94b5e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:53.723307 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66bb094e-b81e-4cdd-8e8e-46af21b94b5e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:53.725987 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66bb094e-b81e-4cdd-8e8e-46af21b94b5e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:54.134404 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-66bb094e-b81e-4cdd-8e8e-46af21b94b5e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:54.146616 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-66bb094e-b81e-4cdd-8e8e-46af21b94b5e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:54.153532 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-66bb094e-b81e-4cdd-8e8e-46af21b94b5e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:54.160495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-66bb094e-b81e-4cdd-8e8e-46af21b94b5e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.476911 Jul 21 22:33:54.161376 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 65/131] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:53 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:54.190948 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4bcec599-3b0b-4b8b-87c8-b15c363d92d3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:54.192135 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4bcec599-3b0b-4b8b-87c8-b15c363d92d3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:54.231719 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4bcec599-3b0b-4b8b-87c8-b15c363d92d3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:54.232360 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4bcec599-3b0b-4b8b-87c8-b15c363d92d3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:54.233525 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4bcec599-3b0b-4b8b-87c8-b15c363d92d3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:54.234185 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4bcec599-3b0b-4b8b-87c8-b15c363d92d3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:54.270547 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=100 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:54.290434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-805d58e5-cb75-45b3-8164-5744735b9e0b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:54.328956 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-805d58e5-cb75-45b3-8164-5744735b9e0b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1548 microversion: 2.1 time: 0.674009 Jul 21 22:33:54.343104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 67/132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:53 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1548 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:54.363444 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0d03093a-c00b-4635-b56f-68f9826486cd tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:54.364302 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0d03093a-c00b-4635-b56f-68f9826486cd tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:54.388493 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0d03093a-c00b-4635-b56f-68f9826486cd tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:54.395580 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0d03093a-c00b-4635-b56f-68f9826486cd tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:54.397986 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0d03093a-c00b-4635-b56f-68f9826486cd tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:54.402664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0d03093a-c00b-4635-b56f-68f9826486cd tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:54.601616 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4bcec599-3b0b-4b8b-87c8-b15c363d92d3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:54.617564 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4bcec599-3b0b-4b8b-87c8-b15c363d92d3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.449489 Jul 21 22:33:54.618166 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 66/133] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:54 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:54.640643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0d03093a-c00b-4635-b56f-68f9826486cd tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.284382 Jul 21 22:33:54.652459 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 68/134] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 22:33:54 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/os-interface => generated 284 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:33:55.209779 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-decf55ae-eb4a-4c6b-999d-513ef1303187 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:55.212642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-decf55ae-eb4a-4c6b-999d-513ef1303187 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:55.230070 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-decf55ae-eb4a-4c6b-999d-513ef1303187 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:55.230893 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-decf55ae-eb4a-4c6b-999d-513ef1303187 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:55.231953 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-decf55ae-eb4a-4c6b-999d-513ef1303187 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:55.232570 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-decf55ae-eb4a-4c6b-999d-513ef1303187 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:55.640061 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-44de8977-5cb7-4395-9827-c4dcb20d3ab4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:55.640921 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-44de8977-5cb7-4395-9827-c4dcb20d3ab4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:55.648082 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-decf55ae-eb4a-4c6b-999d-513ef1303187 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:55.662933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-decf55ae-eb4a-4c6b-999d-513ef1303187 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:55.674913 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44de8977-5cb7-4395-9827-c4dcb20d3ab4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:55.674913 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44de8977-5cb7-4395-9827-c4dcb20d3ab4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:55.675713 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44de8977-5cb7-4395-9827-c4dcb20d3ab4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:55.676466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-decf55ae-eb4a-4c6b-999d-513ef1303187 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:55.678703 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-decf55ae-eb4a-4c6b-999d-513ef1303187 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1406 microversion: 2.20 time: 0.475677 Jul 21 22:33:55.679565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44de8977-5cb7-4395-9827-c4dcb20d3ab4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:55.684123 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 67/135] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:55 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1406 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:56.396585 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-44de8977-5cb7-4395-9827-c4dcb20d3ab4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:56.405927 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-44de8977-5cb7-4395-9827-c4dcb20d3ab4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.773214 Jul 21 22:33:56.418944 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 69/136] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:55 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:56.715734 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0af5d2bc-6512-4fd5-8d99-1f6da0a704f5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:56.716375 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0af5d2bc-6512-4fd5-8d99-1f6da0a704f5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:56.723026 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0af5d2bc-6512-4fd5-8d99-1f6da0a704f5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:56.723514 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0af5d2bc-6512-4fd5-8d99-1f6da0a704f5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:56.724298 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0af5d2bc-6512-4fd5-8d99-1f6da0a704f5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:56.724732 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0af5d2bc-6512-4fd5-8d99-1f6da0a704f5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:57.174220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-0af5d2bc-6512-4fd5-8d99-1f6da0a704f5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:57.190534 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-0af5d2bc-6512-4fd5-8d99-1f6da0a704f5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:57.193454 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-0af5d2bc-6512-4fd5-8d99-1f6da0a704f5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:57.196168 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0af5d2bc-6512-4fd5-8d99-1f6da0a704f5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1598 microversion: 2.20 time: 0.485012 Jul 21 22:33:57.208675 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 68/137] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:56 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1598 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:33:57.235142 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0f8af736-213d-4976-a17b-cde3b5711db9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:57.236288 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0f8af736-213d-4976-a17b-cde3b5711db9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:57.244435 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=77 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:57.284762 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f8af736-213d-4976-a17b-cde3b5711db9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:57.288735 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f8af736-213d-4976-a17b-cde3b5711db9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:57.292071 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f8af736-213d-4976-a17b-cde3b5711db9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:57.294064 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f8af736-213d-4976-a17b-cde3b5711db9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:57.428216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7fa6f090-d48c-4ab5-8d94-6e47d0c22d5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:57.429086 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7fa6f090-d48c-4ab5-8d94-6e47d0c22d5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:57.446925 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7fa6f090-d48c-4ab5-8d94-6e47d0c22d5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:57.449065 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7fa6f090-d48c-4ab5-8d94-6e47d0c22d5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:57.449899 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7fa6f090-d48c-4ab5-8d94-6e47d0c22d5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:57.453472 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7fa6f090-d48c-4ab5-8d94-6e47d0c22d5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:57.529785 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0f8af736-213d-4976-a17b-cde3b5711db9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.302711 Jul 21 22:33:57.530386 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 70/138] 10.222.0.58 () {60 vars in 1315 bytes} [Thu Jul 21 22:33:57 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-interface => generated 284 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:33:57.914575 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-9a8361b2-a4b5-425d-a163-566184c52de8 req-bd30b296-bbb6-40cc-8119-c9c8701d55f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa905ed-e5e9-4837-8aca-77fff9f6d722", "tag": "93173e49-e7da-4add-9d87-eb54a10842e3"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:57.950686 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-9a8361b2-a4b5-425d-a163-566184c52de8 req-bd30b296-bbb6-40cc-8119-c9c8701d55f5 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:57.951450 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-9a8361b2-a4b5-425d-a163-566184c52de8 req-bd30b296-bbb6-40cc-8119-c9c8701d55f5 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:58.022441 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-9a8361b2-a4b5-425d-a163-566184c52de8 req-bd30b296-bbb6-40cc-8119-c9c8701d55f5 service nova] Creating event network-changed:93173e49-e7da-4add-9d87-eb54a10842e3 for instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 on hv-cinder-85069 Jul 21 22:33:58.042266 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-9a8361b2-a4b5-425d-a163-566184c52de8 req-bd30b296-bbb6-40cc-8119-c9c8701d55f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142250 Jul 21 22:33:58.043670 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 71/139] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 21 22:33:58.165483 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7fa6f090-d48c-4ab5-8d94-6e47d0c22d5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:58.180105 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7fa6f090-d48c-4ab5-8d94-6e47d0c22d5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.759500 Jul 21 22:33:58.180724 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 69/140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:57 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:59.207337 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c69485b1-6534-4f5d-be75-9d63616cf8c7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:59.208047 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c69485b1-6534-4f5d-be75-9d63616cf8c7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:59.223866 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c69485b1-6534-4f5d-be75-9d63616cf8c7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:59.224587 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c69485b1-6534-4f5d-be75-9d63616cf8c7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:59.225564 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c69485b1-6534-4f5d-be75-9d63616cf8c7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:59.226159 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c69485b1-6534-4f5d-be75-9d63616cf8c7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:59.623210 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c69485b1-6534-4f5d-be75-9d63616cf8c7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:59.652092 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c69485b1-6534-4f5d-be75-9d63616cf8c7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.447348 Jul 21 22:33:59.653610 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 72/141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:59 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:00.544360 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-29893568-c4b6-4c6b-a472-34ee71f77c43 req-51364a2d-8ec5-4032-a71b-2d251bb35edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdafcf28-8b2d-4692-ba35-cd63d2c32de7", "tag": "7beeb33e-b868-478b-961b-f1fcce969c8c"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:00.554882 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-29893568-c4b6-4c6b-a472-34ee71f77c43 req-51364a2d-8ec5-4032-a71b-2d251bb35edb service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:00.555366 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-29893568-c4b6-4c6b-a472-34ee71f77c43 req-51364a2d-8ec5-4032-a71b-2d251bb35edb service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:00.569905 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-29893568-c4b6-4c6b-a472-34ee71f77c43 req-51364a2d-8ec5-4032-a71b-2d251bb35edb service nova] Creating event network-changed:7beeb33e-b868-478b-961b-f1fcce969c8c for instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 on hv-cinder-85069 Jul 21 22:34:00.577408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-29893568-c4b6-4c6b-a472-34ee71f77c43 req-51364a2d-8ec5-4032-a71b-2d251bb35edb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038053 Jul 21 22:34:00.578342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 70/142] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:34:00.682222 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-77fd2e30-43de-43f5-918e-caa879323a2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:00.683099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-77fd2e30-43de-43f5-918e-caa879323a2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:00.699141 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-77fd2e30-43de-43f5-918e-caa879323a2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:00.699727 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-77fd2e30-43de-43f5-918e-caa879323a2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:00.700571 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-77fd2e30-43de-43f5-918e-caa879323a2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:00.701017 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-77fd2e30-43de-43f5-918e-caa879323a2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:01.047794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-77fd2e30-43de-43f5-918e-caa879323a2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:01.079940 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-77fd2e30-43de-43f5-918e-caa879323a2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.402125 Jul 21 22:34:01.086232 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 73/143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:00 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:02.135360 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c84affab-ed23-49b2-ba3d-58db423cb526 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:02.148379 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c84affab-ed23-49b2-ba3d-58db423cb526 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:02.175492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=71 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:02.184624 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c84affab-ed23-49b2-ba3d-58db423cb526 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:02.186379 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c84affab-ed23-49b2-ba3d-58db423cb526 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:02.189172 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c84affab-ed23-49b2-ba3d-58db423cb526 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:02.190742 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c84affab-ed23-49b2-ba3d-58db423cb526 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:02.487467 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c84affab-ed23-49b2-ba3d-58db423cb526 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:02.511414 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c84affab-ed23-49b2-ba3d-58db423cb526 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.400424 Jul 21 22:34:02.519825 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 71/144] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:02 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:03.460457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-369372aa-63bb-4733-9052-1020dfcfe3fc tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:03.462208 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-369372aa-63bb-4733-9052-1020dfcfe3fc tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:03.473073 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-369372aa-63bb-4733-9052-1020dfcfe3fc tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:03.474450 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-369372aa-63bb-4733-9052-1020dfcfe3fc tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:03.475977 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-369372aa-63bb-4733-9052-1020dfcfe3fc tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:03.476703 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-369372aa-63bb-4733-9052-1020dfcfe3fc tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:03.524162 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-369372aa-63bb-4733-9052-1020dfcfe3fc tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:34:03.540188 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e3bbc0f6-eb50-4dc6-a678-6a16ab72b6d4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:03.542893 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e3bbc0f6-eb50-4dc6-a678-6a16ab72b6d4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:03.575705 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e3bbc0f6-eb50-4dc6-a678-6a16ab72b6d4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:03.576468 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e3bbc0f6-eb50-4dc6-a678-6a16ab72b6d4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:03.577900 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e3bbc0f6-eb50-4dc6-a678-6a16ab72b6d4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:03.578671 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e3bbc0f6-eb50-4dc6-a678-6a16ab72b6d4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:03.741653 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-369372aa-63bb-4733-9052-1020dfcfe3fc tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 204 len: 0 microversion: 2.1 time: 0.286281 Jul 21 22:34:03.742873 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 74/145] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:34:03 2022] DELETE /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:34:03.756824 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1897689e-44aa-4418-bb51-9067535dbf59 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:03.757860 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1897689e-44aa-4418-bb51-9067535dbf59 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:03.770285 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1897689e-44aa-4418-bb51-9067535dbf59 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:03.772941 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1897689e-44aa-4418-bb51-9067535dbf59 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:03.776956 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1897689e-44aa-4418-bb51-9067535dbf59 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:03.780984 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1897689e-44aa-4418-bb51-9067535dbf59 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:03.943119 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e3bbc0f6-eb50-4dc6-a678-6a16ab72b6d4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:03.975930 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e3bbc0f6-eb50-4dc6-a678-6a16ab72b6d4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.440935 Jul 21 22:34:03.977099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 72/146] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:03 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:04.148410 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1897689e-44aa-4418-bb51-9067535dbf59 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:04.163554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1897689e-44aa-4418-bb51-9067535dbf59 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1555 microversion: 2.1 time: 0.412072 Jul 21 22:34:04.173840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 75/147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:03 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1555 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:05.000275 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f6643650-c62c-4017-8994-823902922cdb tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:05.003258 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f6643650-c62c-4017-8994-823902922cdb tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:05.033346 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6643650-c62c-4017-8994-823902922cdb tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:05.033865 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6643650-c62c-4017-8994-823902922cdb tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:05.034987 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6643650-c62c-4017-8994-823902922cdb tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:05.035563 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6643650-c62c-4017-8994-823902922cdb tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:05.186360 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-074e1837-f7f9-4214-8a45-43f7379b7b81 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:05.188576 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-074e1837-f7f9-4214-8a45-43f7379b7b81 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:05.222931 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-074e1837-f7f9-4214-8a45-43f7379b7b81 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:05.223615 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-074e1837-f7f9-4214-8a45-43f7379b7b81 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:05.224484 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-074e1837-f7f9-4214-8a45-43f7379b7b81 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:05.224924 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-074e1837-f7f9-4214-8a45-43f7379b7b81 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:05.440963 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f6643650-c62c-4017-8994-823902922cdb tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:05.450336 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f6643650-c62c-4017-8994-823902922cdb tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.459281 Jul 21 22:34:05.460555 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 73/148] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:04 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:05.565493 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-074e1837-f7f9-4214-8a45-43f7379b7b81 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:05.595618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-074e1837-f7f9-4214-8a45-43f7379b7b81 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1555 microversion: 2.1 time: 0.416523 Jul 21 22:34:05.601007 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 76/149] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:05 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1555 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:06.468103 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d73e4542-379b-4ad5-9672-6d50569f0a14 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:06.469447 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d73e4542-379b-4ad5-9672-6d50569f0a14 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:06.480097 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d73e4542-379b-4ad5-9672-6d50569f0a14 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:06.488299 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d73e4542-379b-4ad5-9672-6d50569f0a14 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:06.489252 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d73e4542-379b-4ad5-9672-6d50569f0a14 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:06.489696 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d73e4542-379b-4ad5-9672-6d50569f0a14 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:06.619265 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-fb26ad55-782e-4a1a-b1c4-db2768627b62 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:06.620900 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-fb26ad55-782e-4a1a-b1c4-db2768627b62 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:06.649056 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fb26ad55-782e-4a1a-b1c4-db2768627b62 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:06.651281 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fb26ad55-782e-4a1a-b1c4-db2768627b62 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:06.665889 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fb26ad55-782e-4a1a-b1c4-db2768627b62 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:06.665889 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fb26ad55-782e-4a1a-b1c4-db2768627b62 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:07.168440 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d73e4542-379b-4ad5-9672-6d50569f0a14 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:07.177578 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d73e4542-379b-4ad5-9672-6d50569f0a14 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.713499 Jul 21 22:34:07.183196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 74/150] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:06 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:07.217676 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-fb26ad55-782e-4a1a-b1c4-db2768627b62 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:07.239404 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-fb26ad55-782e-4a1a-b1c4-db2768627b62 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1555 microversion: 2.1 time: 0.628880 Jul 21 22:34:07.245029 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 77/151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:06 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1555 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:07.867530 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-5390822c-f54c-476d-84b2-502f34be8cee req-0e8e7ce7-2933-43e9-81a9-929677a0d179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d2d5c65-369e-40c5-9218-9be17b9bf09b", "name": "network-vif-deleted", "tag": "a9c8cd4d-fcdb-4161-9b9c-20c9deff216d"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:07.913978 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-5390822c-f54c-476d-84b2-502f34be8cee req-0e8e7ce7-2933-43e9-81a9-929677a0d179 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:07.918707 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-5390822c-f54c-476d-84b2-502f34be8cee req-0e8e7ce7-2933-43e9-81a9-929677a0d179 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:07.964423 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-5390822c-f54c-476d-84b2-502f34be8cee req-0e8e7ce7-2933-43e9-81a9-929677a0d179 service nova] Creating event network-vif-deleted:a9c8cd4d-fcdb-4161-9b9c-20c9deff216d for instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b on hv-cinder-85069 Jul 21 22:34:07.974963 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-5390822c-f54c-476d-84b2-502f34be8cee req-0e8e7ce7-2933-43e9-81a9-929677a0d179 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115039 Jul 21 22:34:07.982553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 75/152] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:08.215208 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-49f4be29-bc76-49dc-9182-ceacb149a00c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:08.216509 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-49f4be29-bc76-49dc-9182-ceacb149a00c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:08.239179 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-49f4be29-bc76-49dc-9182-ceacb149a00c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:08.245739 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-49f4be29-bc76-49dc-9182-ceacb149a00c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:08.253551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-49f4be29-bc76-49dc-9182-ceacb149a00c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:08.255748 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-49f4be29-bc76-49dc-9182-ceacb149a00c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:08.272732 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1566431f-c2cb-4ca2-9a8a-824bf4fc6682 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:08.277739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1566431f-c2cb-4ca2-9a8a-824bf4fc6682 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:08.297116 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1566431f-c2cb-4ca2-9a8a-824bf4fc6682 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:08.300116 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1566431f-c2cb-4ca2-9a8a-824bf4fc6682 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:08.302267 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1566431f-c2cb-4ca2-9a8a-824bf4fc6682 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:08.307220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1566431f-c2cb-4ca2-9a8a-824bf4fc6682 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:08.607732 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1566431f-c2cb-4ca2-9a8a-824bf4fc6682 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c07a46f581b4bbb97ad99005471ebe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7d739ba4574964821462bf4be0e1f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:08.633742 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1566431f-c2cb-4ca2-9a8a-824bf4fc6682 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 200 len: 1346 microversion: 2.1 time: 0.368878 Jul 21 22:34:08.641386 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 76/153] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:08 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 1346 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:08.742331 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-49f4be29-bc76-49dc-9182-ceacb149a00c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:08.772011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-49f4be29-bc76-49dc-9182-ceacb149a00c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.563601 Jul 21 22:34:08.775324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 78/154] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:08 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:09.683414 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-92bb4697-7a86-47a2-8f8a-73355c40c5d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:09.685902 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-92bb4697-7a86-47a2-8f8a-73355c40c5d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:09.699279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-92bb4697-7a86-47a2-8f8a-73355c40c5d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:09.700213 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-92bb4697-7a86-47a2-8f8a-73355c40c5d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:09.702913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-92bb4697-7a86-47a2-8f8a-73355c40c5d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:09.703926 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-92bb4697-7a86-47a2-8f8a-73355c40c5d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:09.735458 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-92bb4697-7a86-47a2-8f8a-73355c40c5d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] HTTP exception thrown: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-92bb4697-7a86-47a2-8f8a-73355c40c5d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Request method failure captured: Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b HTTP/1.1 Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQfB-6z38CfAGRlB0voGIL9h5tf37DEEor5p3Rvypxo07dUZZnhK8ybwaSKRjxQuJ_V6BNaNmpD8zuAVfXTq-WXoek0u9vnoktgwwIuVJI0EZ97TKfY9zLTa90q_pX2UYymeFDWl3CCML_e9bAYUjOlyKOuObPvzCKAeKOGCrbxFLk Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 7f7d739ba4574964821462bf4be0e1f5 Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:34:09.766287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f7d739ba4574964821462bf4be0e1f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 7f7d739ba4574964821462bf4be0e1f5 Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-DeleteServersTestJSON-1863325778-project Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: 2c07a46f581b4bbb97ad99005471ebe3 Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-DeleteServersTestJSON-1863325778-project Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:09.769044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '0d2d5c65-369e-40c5-9218-9be17b9bf09b'} Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:34:09.771521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:09.773913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:09.778664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-92bb4697-7a86-47a2-8f8a-73355c40c5d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Returning 404 to user: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:34:09.780576 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-92bb4697-7a86-47a2-8f8a-73355c40c5d8 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 404 len: 111 microversion: 2.1 time: 0.111818 Jul 21 22:34:09.783740 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 77/155] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:09 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:34:09.801110 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-06426c03-4fc6-4530-aafb-26554e3c3fcf tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:09.801714 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-06426c03-4fc6-4530-aafb-26554e3c3fcf tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:09.815221 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06426c03-4fc6-4530-aafb-26554e3c3fcf tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:09.816243 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06426c03-4fc6-4530-aafb-26554e3c3fcf tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:09.819731 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06426c03-4fc6-4530-aafb-26554e3c3fcf tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:09.822058 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06426c03-4fc6-4530-aafb-26554e3c3fcf tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:10.063423 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f9c841f2-59c5-4ef0-af7b-4c5965c85494 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:10.065137 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f9c841f2-59c5-4ef0-af7b-4c5965c85494 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:10.080800 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-06426c03-4fc6-4530-aafb-26554e3c3fcf tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:10.101052 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-06426c03-4fc6-4530-aafb-26554e3c3fcf tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.303698 Jul 21 22:34:10.103760 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 79/156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:09 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:10.108105 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9c841f2-59c5-4ef0-af7b-4c5965c85494 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:10.109925 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9c841f2-59c5-4ef0-af7b-4c5965c85494 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:10.111517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9c841f2-59c5-4ef0-af7b-4c5965c85494 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:10.112619 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9c841f2-59c5-4ef0-af7b-4c5965c85494 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:10.211027 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-f9c841f2-59c5-4ef0-af7b-4c5965c85494 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] HTTP exception thrown: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f9c841f2-59c5-4ef0-af7b-4c5965c85494 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Request method failure captured: Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b/os-volume_attachments HTTP/1.1 Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQfB-6z38CfAGRlB0voGIL9h5tf37DEEor5p3Rvypxo07dUZZnhK8ybwaSKRjxQuJ_V6BNaNmpD8zuAVfXTq-WXoek0u9vnoktgwwIuVJI0EZ97TKfY9zLTa90q_pX2UYymeFDWl3CCML_e9bAYUjOlyKOuObPvzCKAeKOGCrbxFLk Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 7f7d739ba4574964821462bf4be0e1f5 Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:34:10.214647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f7d739ba4574964821462bf4be0e1f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 7f7d739ba4574964821462bf4be0e1f5 Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-DeleteServersTestJSON-1863325778-project Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: 2c07a46f581b4bbb97ad99005471ebe3 Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-DeleteServersTestJSON-1863325778-project Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:10.217212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'server_id': '0d2d5c65-369e-40c5-9218-9be17b9bf09b'} Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:34:10.221219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:10.224753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:10.228425 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f9c841f2-59c5-4ef0-af7b-4c5965c85494 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Returning 404 to user: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:34:10.228425 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f9c841f2-59c5-4ef0-af7b-4c5965c85494 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.162476 Jul 21 22:34:10.228425 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 78/157] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:34:10 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b/os-volume_attachments => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:34:11.133022 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2e73ed7f-19fe-4a2f-aef2-3e9be2458313 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:11.133972 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2e73ed7f-19fe-4a2f-aef2-3e9be2458313 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:11.148668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2e73ed7f-19fe-4a2f-aef2-3e9be2458313 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:11.150410 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2e73ed7f-19fe-4a2f-aef2-3e9be2458313 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:11.152029 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2e73ed7f-19fe-4a2f-aef2-3e9be2458313 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:11.153280 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2e73ed7f-19fe-4a2f-aef2-3e9be2458313 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:11.348363 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-2e73ed7f-19fe-4a2f-aef2-3e9be2458313 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:11.358029 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2e73ed7f-19fe-4a2f-aef2-3e9be2458313 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.229226 Jul 21 22:34:11.358762 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 80/158] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:11 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:11.673354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-dff87646-89ba-4749-a267-40eaa3286a69 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:11.674100 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-dff87646-89ba-4749-a267-40eaa3286a69 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:11.682759 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dff87646-89ba-4749-a267-40eaa3286a69 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:11.683770 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dff87646-89ba-4749-a267-40eaa3286a69 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:11.684751 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dff87646-89ba-4749-a267-40eaa3286a69 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:11.685667 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dff87646-89ba-4749-a267-40eaa3286a69 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:11.710258 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-dff87646-89ba-4749-a267-40eaa3286a69 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] HTTP exception thrown: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-dff87646-89ba-4749-a267-40eaa3286a69 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Request method failure captured: Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: DELETE /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b HTTP/1.1 Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQfB-6z38CfAGRlB0voGIL9h5tf37DEEor5p3Rvypxo07dUZZnhK8ybwaSKRjxQuJ_V6BNaNmpD8zuAVfXTq-WXoek0u9vnoktgwwIuVJI0EZ97TKfY9zLTa90q_pX2UYymeFDWl3CCML_e9bAYUjOlyKOuObPvzCKAeKOGCrbxFLk Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 7f7d739ba4574964821462bf4be0e1f5 Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:34:11.714177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f7d739ba4574964821462bf4be0e1f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 7f7d739ba4574964821462bf4be0e1f5 Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-DeleteServersTestJSON-1863325778-project Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: 2c07a46f581b4bbb97ad99005471ebe3 Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-DeleteServersTestJSON-1863325778-project Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:11.715495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '0d2d5c65-369e-40c5-9218-9be17b9bf09b'} Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:34:11.716161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:11.717216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:34:11.721541 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-dff87646-89ba-4749-a267-40eaa3286a69 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Returning 404 to user: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:34:11.721541 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-dff87646-89ba-4749-a267-40eaa3286a69 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 404 len: 111 microversion: 2.1 time: 0.049363 Jul 21 22:34:11.721541 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 79/159] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:34:11 2022] DELETE /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:34:11.727362 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-66438d83-0671-4a49-a13f-153d95526b15 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:11.728755 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-66438d83-0671-4a49-a13f-153d95526b15 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] [instance: 0d2d5c65-369e-40c5-9218-9be17b9bf09b] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:11.737369 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-66438d83-0671-4a49-a13f-153d95526b15 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:11.738100 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-66438d83-0671-4a49-a13f-153d95526b15 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:11.739021 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-66438d83-0671-4a49-a13f-153d95526b15 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:11.739602 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-66438d83-0671-4a49-a13f-153d95526b15 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:11.760957 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-66438d83-0671-4a49-a13f-153d95526b15 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] HTTP exception thrown: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-66438d83-0671-4a49-a13f-153d95526b15 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Request method failure captured: Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b HTTP/1.1 Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQfB-6z38CfAGRlB0voGIL9h5tf37DEEor5p3Rvypxo07dUZZnhK8ybwaSKRjxQuJ_V6BNaNmpD8zuAVfXTq-WXoek0u9vnoktgwwIuVJI0EZ97TKfY9zLTa90q_pX2UYymeFDWl3CCML_e9bAYUjOlyKOuObPvzCKAeKOGCrbxFLk Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 7f7d739ba4574964821462bf4be0e1f5 Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:34:11.767840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f7d739ba4574964821462bf4be0e1f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f7d739ba4574964821462bf4be0e1f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 7f7d739ba4574964821462bf4be0e1f5 Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-DeleteServersTestJSON-1863325778 Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-DeleteServersTestJSON-1863325778-project Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 2c07a46f581b4bbb97ad99005471ebe3 Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-DeleteServersTestJSON-1863325778-project Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:11.769297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': '0d2d5c65-369e-40c5-9218-9be17b9bf09b'} Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:34:11.769932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. Jul 21 22:34:11.771306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:34:11.772256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-66438d83-0671-4a49-a13f-153d95526b15 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] Returning 404 to user: Instance 0d2d5c65-369e-40c5-9218-9be17b9bf09b could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:34:11.772256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-66438d83-0671-4a49-a13f-153d95526b15 tempest-DeleteServersTestJSON-1863325778 tempest-DeleteServersTestJSON-1863325778-project] 10.222.0.58 "GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b" status: 404 len: 111 microversion: 2.1 time: 0.047481 Jul 21 22:34:11.772256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 81/160] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:11 2022] GET /compute/v2.1/servers/0d2d5c65-369e-40c5-9218-9be17b9bf09b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:34:12.383400 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-60e91738-90d8-4e30-a829-96be6f787067 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:12.387886 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-60e91738-90d8-4e30-a829-96be6f787067 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:12.411764 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-60e91738-90d8-4e30-a829-96be6f787067 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:12.412364 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-60e91738-90d8-4e30-a829-96be6f787067 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:12.414195 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-60e91738-90d8-4e30-a829-96be6f787067 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:12.414839 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-60e91738-90d8-4e30-a829-96be6f787067 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:12.649773 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-60e91738-90d8-4e30-a829-96be6f787067 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:12.676531 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-60e91738-90d8-4e30-a829-96be6f787067 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.303292 Jul 21 22:34:12.678931 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 80/161] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:12 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:13.712142 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-da60bf44-6944-405b-b639-458a5ca04435 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:13.715926 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-da60bf44-6944-405b-b639-458a5ca04435 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:13.745275 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-da60bf44-6944-405b-b639-458a5ca04435 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:13.755445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-da60bf44-6944-405b-b639-458a5ca04435 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:13.757439 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-da60bf44-6944-405b-b639-458a5ca04435 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:13.758683 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-da60bf44-6944-405b-b639-458a5ca04435 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:14.280374 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-da60bf44-6944-405b-b639-458a5ca04435 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:14.314261 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-da60bf44-6944-405b-b639-458a5ca04435 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.598616 Jul 21 22:34:14.326113 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 82/162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:13 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:15.339902 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ec8742b3-b6e1-41df-a2c4-f8a059f7cc4e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:15.364707 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ec8742b3-b6e1-41df-a2c4-f8a059f7cc4e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:15.388142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ec8742b3-b6e1-41df-a2c4-f8a059f7cc4e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:15.389053 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ec8742b3-b6e1-41df-a2c4-f8a059f7cc4e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:15.390522 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ec8742b3-b6e1-41df-a2c4-f8a059f7cc4e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:15.406547 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ec8742b3-b6e1-41df-a2c4-f8a059f7cc4e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:15.939407 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ec8742b3-b6e1-41df-a2c4-f8a059f7cc4e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:15.951513 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ec8742b3-b6e1-41df-a2c4-f8a059f7cc4e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.619592 Jul 21 22:34:15.954394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 81/163] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:15 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:16.973805 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-22c9f362-a184-42e8-8612-37f59c7484ae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:16.976274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-22c9f362-a184-42e8-8612-37f59c7484ae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:17.013255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-22c9f362-a184-42e8-8612-37f59c7484ae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:17.015885 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-22c9f362-a184-42e8-8612-37f59c7484ae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:17.020080 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-22c9f362-a184-42e8-8612-37f59c7484ae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:17.021132 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-22c9f362-a184-42e8-8612-37f59c7484ae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:17.307400 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-22c9f362-a184-42e8-8612-37f59c7484ae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:17.328408 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:17.328408 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-22c9f362-a184-42e8-8612-37f59c7484ae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.357644 Jul 21 22:34:17.328408 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 83/164] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:16 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:18.353885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-184f1f32-733e-4720-b350-1089ca17c2b7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:18.354491 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-184f1f32-733e-4720-b350-1089ca17c2b7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:18.366136 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-184f1f32-733e-4720-b350-1089ca17c2b7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:18.370574 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-184f1f32-733e-4720-b350-1089ca17c2b7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:18.385294 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-184f1f32-733e-4720-b350-1089ca17c2b7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:18.385294 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-184f1f32-733e-4720-b350-1089ca17c2b7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:19.054911 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-184f1f32-733e-4720-b350-1089ca17c2b7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:19.065982 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-184f1f32-733e-4720-b350-1089ca17c2b7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.716318 Jul 21 22:34:19.066947 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 82/165] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:18 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:20.090248 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-648e2435-2d07-4e1a-9cc0-0d510025d32f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:20.101053 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-648e2435-2d07-4e1a-9cc0-0d510025d32f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:20.109431 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-648e2435-2d07-4e1a-9cc0-0d510025d32f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:20.110056 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-648e2435-2d07-4e1a-9cc0-0d510025d32f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:20.111018 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-648e2435-2d07-4e1a-9cc0-0d510025d32f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:20.111619 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-648e2435-2d07-4e1a-9cc0-0d510025d32f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:20.505210 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-648e2435-2d07-4e1a-9cc0-0d510025d32f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:20.524410 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-648e2435-2d07-4e1a-9cc0-0d510025d32f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.438896 Jul 21 22:34:20.526281 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 84/166] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:20 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:21.559936 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3e31baab-9203-4ea4-bb95-cf3fed24ed45 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:21.563381 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3e31baab-9203-4ea4-bb95-cf3fed24ed45 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:21.593264 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3e31baab-9203-4ea4-bb95-cf3fed24ed45 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:21.594269 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3e31baab-9203-4ea4-bb95-cf3fed24ed45 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:21.595940 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3e31baab-9203-4ea4-bb95-cf3fed24ed45 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:21.596855 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3e31baab-9203-4ea4-bb95-cf3fed24ed45 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:21.980399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3e31baab-9203-4ea4-bb95-cf3fed24ed45 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:22.008296 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3e31baab-9203-4ea4-bb95-cf3fed24ed45 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.458340 Jul 21 22:34:22.010028 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 83/167] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:21 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:23.038322 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-eda372a2-9a75-4d27-bf8a-0c19d2917060 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:23.040535 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-eda372a2-9a75-4d27-bf8a-0c19d2917060 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:23.052768 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-eda372a2-9a75-4d27-bf8a-0c19d2917060 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:23.053935 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-eda372a2-9a75-4d27-bf8a-0c19d2917060 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:23.056422 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-eda372a2-9a75-4d27-bf8a-0c19d2917060 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:23.057482 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-eda372a2-9a75-4d27-bf8a-0c19d2917060 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:23.276303 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-eda372a2-9a75-4d27-bf8a-0c19d2917060 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:23.293638 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-eda372a2-9a75-4d27-bf8a-0c19d2917060 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.262328 Jul 21 22:34:23.295479 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 85/168] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:23 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:24.326957 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3093f8dc-2282-4cde-8b88-9e109c21c002 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:24.328657 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3093f8dc-2282-4cde-8b88-9e109c21c002 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:24.339642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3093f8dc-2282-4cde-8b88-9e109c21c002 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:24.341299 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3093f8dc-2282-4cde-8b88-9e109c21c002 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:24.343411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3093f8dc-2282-4cde-8b88-9e109c21c002 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:24.344426 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3093f8dc-2282-4cde-8b88-9e109c21c002 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:24.356530 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=85 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:24.530271 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3093f8dc-2282-4cde-8b88-9e109c21c002 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:24.548810 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3093f8dc-2282-4cde-8b88-9e109c21c002 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.231236 Jul 21 22:34:24.569538 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 84/169] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:24 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:25.581128 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-dd22b06e-7d54-4170-8a60-df3f65890adc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:25.582622 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-dd22b06e-7d54-4170-8a60-df3f65890adc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:25.593401 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd22b06e-7d54-4170-8a60-df3f65890adc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:25.599093 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd22b06e-7d54-4170-8a60-df3f65890adc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:25.602863 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd22b06e-7d54-4170-8a60-df3f65890adc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:25.604963 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd22b06e-7d54-4170-8a60-df3f65890adc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:25.886128 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-dd22b06e-7d54-4170-8a60-df3f65890adc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:25.900864 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-dd22b06e-7d54-4170-8a60-df3f65890adc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.324989 Jul 21 22:34:25.902303 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 86/170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:25 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:26.921694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c0ac7737-8b86-47e3-bbee-05528fe12d8f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:26.922533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c0ac7737-8b86-47e3-bbee-05528fe12d8f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:26.929582 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c0ac7737-8b86-47e3-bbee-05528fe12d8f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:26.930044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c0ac7737-8b86-47e3-bbee-05528fe12d8f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:26.931032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c0ac7737-8b86-47e3-bbee-05528fe12d8f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:26.931898 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c0ac7737-8b86-47e3-bbee-05528fe12d8f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:27.212713 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c0ac7737-8b86-47e3-bbee-05528fe12d8f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:27.235264 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c0ac7737-8b86-47e3-bbee-05528fe12d8f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.317612 Jul 21 22:34:27.246003 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 85/171] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:26 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:28.263634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-30f571e2-678b-4cf9-980b-05db699eb209 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:28.264773 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-30f571e2-678b-4cf9-980b-05db699eb209 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:28.268733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:28.311318 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-30f571e2-678b-4cf9-980b-05db699eb209 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:28.312429 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-30f571e2-678b-4cf9-980b-05db699eb209 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:28.315170 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-30f571e2-678b-4cf9-980b-05db699eb209 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:28.317550 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-30f571e2-678b-4cf9-980b-05db699eb209 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:28.570610 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-30f571e2-678b-4cf9-980b-05db699eb209 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:28.600276 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-30f571e2-678b-4cf9-980b-05db699eb209 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.348932 Jul 21 22:34:28.613323 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 87/172] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:28 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:28.798828 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3566a886-79f6-4348-9b45-3820a57e438a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: .version_select at 0x7f47e865bd30>, body: {"keypair": {"name": "tempest-keypair-1326031101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5UFWoY9Xa+IM27ojmygcS/nXpSKgfVeVQf1d/ye8Q9KCjMsmGvpuJoKfjri6bmXdSGI3ElkQe/17TLWSgNr+rV2/yeH4jO5vVKP1ucrgcdunS3pnSKfLomwsB1EO2w5w=="}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:28.815651 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-3566a886-79f6-4348-9b45-3820a57e438a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'key_pairs'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:34:28.820426 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-3566a886-79f6-4348-9b45-3820a57e438a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for user c4284eb173fc49d1b059fdd2f3de2b4d and project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'key_pairs'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:34:28.848704 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3566a886-79f6-4348-9b45-3820a57e438a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.279949 Jul 21 22:34:28.849538 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 86/173] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 22:34:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:34:29.626157 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-07099c2a-a115-4106-b1f3-51818952dca0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:29.627530 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-07099c2a-a115-4106-b1f3-51818952dca0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:29.639823 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-07099c2a-a115-4106-b1f3-51818952dca0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:29.640756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-07099c2a-a115-4106-b1f3-51818952dca0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:29.642009 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-07099c2a-a115-4106-b1f3-51818952dca0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:29.642929 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-07099c2a-a115-4106-b1f3-51818952dca0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:30.305426 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-07099c2a-a115-4106-b1f3-51818952dca0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:30.346961 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-07099c2a-a115-4106-b1f3-51818952dca0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.729568 Jul 21 22:34:30.348747 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 88/174] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:29 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:31.378891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6719687b-d3d2-412b-a408-e45e7ac82c44 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:31.379713 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6719687b-d3d2-412b-a408-e45e7ac82c44 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:31.396848 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6719687b-d3d2-412b-a408-e45e7ac82c44 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:31.397303 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6719687b-d3d2-412b-a408-e45e7ac82c44 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:31.398102 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6719687b-d3d2-412b-a408-e45e7ac82c44 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:31.409586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6719687b-d3d2-412b-a408-e45e7ac82c44 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:31.726399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6719687b-d3d2-412b-a408-e45e7ac82c44 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:31.750433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6719687b-d3d2-412b-a408-e45e7ac82c44 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1522 microversion: 2.1 time: 0.377897 Jul 21 22:34:31.751037 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 87/175] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:31 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:32.140819 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1216827553", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f846e054-e088-4d42-aada-300493577c1f"}], "security_groups": [{"name": "tempest-securitygroup--681578695"}], "key_name": "tempest-keypair-1326031101", "user_data": "}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:32.301133 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] validate_networks() for [('f846e054-e088-4d42-aada-300493577c1f', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:34:32.793156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-48f39e28-12e7-460c-92f4-3b9f499080ea tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:32.803408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-48f39e28-12e7-460c-92f4-3b9f499080ea tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:32.819243 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:32.862126 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48f39e28-12e7-460c-92f4-3b9f499080ea tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:32.863534 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48f39e28-12e7-460c-92f4-3b9f499080ea tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:32.864665 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48f39e28-12e7-460c-92f4-3b9f499080ea tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:32.865359 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48f39e28-12e7-460c-92f4-3b9f499080ea tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:33.127479 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:34:33.129271 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:34:33.131229 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:34:33.132727 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:34:33.134942 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:34:33.173512 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:33.174930 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:33.176119 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:33.176884 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:33.215639 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:34:33.228387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for user c4284eb173fc49d1b059fdd2f3de2b4d and project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:34:33.246242 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:34:33.249176 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:34:33.372292 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-48f39e28-12e7-460c-92f4-3b9f499080ea tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:33.398613 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-48f39e28-12e7-460c-92f4-3b9f499080ea tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1502 microversion: 2.1 time: 0.619745 Jul 21 22:34:33.399490 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d5b3f56b-265e-40e7-8a7c-370ac1b3e122 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.262484 Jul 21 22:34:33.410596 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 88/176] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:32 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1502 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:33.410908 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 89/177] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:34:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:34:33.423437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-da785747-4ac5-454e-a02a-393e7dfa2fe4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:33.433381 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-da785747-4ac5-454e-a02a-393e7dfa2fe4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:33.460175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0c581941-5c11-40ac-b666-6fe13c9cc0f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:33.460175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0c581941-5c11-40ac-b666-6fe13c9cc0f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:33.490585 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0c581941-5c11-40ac-b666-6fe13c9cc0f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:33.492449 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0c581941-5c11-40ac-b666-6fe13c9cc0f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:33.492449 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0c581941-5c11-40ac-b666-6fe13c9cc0f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:33.492695 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0c581941-5c11-40ac-b666-6fe13c9cc0f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:33.530249 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-da785747-4ac5-454e-a02a-393e7dfa2fe4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:33.539290 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-da785747-4ac5-454e-a02a-393e7dfa2fe4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1242 microversion: 2.1 time: 0.126819 Jul 21 22:34:33.540454 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 89/178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:33 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:34.088246 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-0c581941-5c11-40ac-b666-6fe13c9cc0f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:34.115481 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0c581941-5c11-40ac-b666-6fe13c9cc0f9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1516 microversion: 2.1 time: 0.680590 Jul 21 22:34:34.117081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 90/179] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:33 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1516 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:34.560018 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1c95de92-b970-4d63-9a62-25e74299e3a8 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:34.561492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1c95de92-b970-4d63-9a62-25e74299e3a8 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:34.570236 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c95de92-b970-4d63-9a62-25e74299e3a8 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:34.571751 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c95de92-b970-4d63-9a62-25e74299e3a8 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:34.575794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c95de92-b970-4d63-9a62-25e74299e3a8 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:34.576585 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c95de92-b970-4d63-9a62-25e74299e3a8 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:34.668960 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1c95de92-b970-4d63-9a62-25e74299e3a8 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:34.678578 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1c95de92-b970-4d63-9a62-25e74299e3a8 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1246 microversion: 2.1 time: 0.125608 Jul 21 22:34:34.689473 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 90/180] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:34 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1246 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:35.709822 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1e7dd302-1cf5-4e6b-a662-59c65c231031 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:35.711941 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1e7dd302-1cf5-4e6b-a662-59c65c231031 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:35.721445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1e7dd302-1cf5-4e6b-a662-59c65c231031 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:35.722198 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1e7dd302-1cf5-4e6b-a662-59c65c231031 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:35.723525 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1e7dd302-1cf5-4e6b-a662-59c65c231031 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:35.724350 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1e7dd302-1cf5-4e6b-a662-59c65c231031 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:35.856596 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1e7dd302-1cf5-4e6b-a662-59c65c231031 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:35.872669 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1e7dd302-1cf5-4e6b-a662-59c65c231031 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1246 microversion: 2.1 time: 0.177233 Jul 21 22:34:35.874859 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 91/181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:35 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1246 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:36.892404 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-21bfc8e4-dcc2-405a-a025-bb82eca8de6b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:36.893018 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-21bfc8e4-dcc2-405a-a025-bb82eca8de6b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:36.899573 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-21bfc8e4-dcc2-405a-a025-bb82eca8de6b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:36.900011 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-21bfc8e4-dcc2-405a-a025-bb82eca8de6b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:36.900782 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-21bfc8e4-dcc2-405a-a025-bb82eca8de6b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:36.901211 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-21bfc8e4-dcc2-405a-a025-bb82eca8de6b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:36.979689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-21bfc8e4-dcc2-405a-a025-bb82eca8de6b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:36.993284 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-21bfc8e4-dcc2-405a-a025-bb82eca8de6b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1238 microversion: 2.1 time: 0.103786 Jul 21 22:34:36.993877 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 91/182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:36 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:38.012890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b3ee014b-5733-491e-8568-1b443ba74dd7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:38.016912 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b3ee014b-5733-491e-8568-1b443ba74dd7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:38.024772 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-213a512e-bac2-49dc-b55d-e904c012c4b5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:38.026266 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-213a512e-bac2-49dc-b55d-e904c012c4b5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:38.033193 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b3ee014b-5733-491e-8568-1b443ba74dd7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:38.033493 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-213a512e-bac2-49dc-b55d-e904c012c4b5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:38.033827 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-213a512e-bac2-49dc-b55d-e904c012c4b5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:38.033999 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b3ee014b-5733-491e-8568-1b443ba74dd7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:38.034683 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-213a512e-bac2-49dc-b55d-e904c012c4b5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:38.035152 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-213a512e-bac2-49dc-b55d-e904c012c4b5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:38.035445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b3ee014b-5733-491e-8568-1b443ba74dd7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:38.036244 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b3ee014b-5733-491e-8568-1b443ba74dd7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:38.075358 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-b3ee014b-5733-491e-8568-1b443ba74dd7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lazy-loading 'flavor' on Instance uuid 967535ed-7748-4181-a946-d67bfbb813d0 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:34:38.136970 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-213a512e-bac2-49dc-b55d-e904c012c4b5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:38.152062 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-213a512e-bac2-49dc-b55d-e904c012c4b5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1300 microversion: 2.1 time: 0.134888 Jul 21 22:34:38.153351 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 92/183] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:38 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1300 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:38.219842 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b3ee014b-5733-491e-8568-1b443ba74dd7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "POST /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0/action" status: 200 len: 32 microversion: 2.1 time: 0.214521 Jul 21 22:34:38.220927 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 92/184] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:34:38 2022] POST /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:34:38.237602 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d2bcff93-0916-4b2c-82d1-b2266f79ade0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:38.239097 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d2bcff93-0916-4b2c-82d1-b2266f79ade0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:38.248531 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d2bcff93-0916-4b2c-82d1-b2266f79ade0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:38.249177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d2bcff93-0916-4b2c-82d1-b2266f79ade0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:38.250107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d2bcff93-0916-4b2c-82d1-b2266f79ade0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:38.250640 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d2bcff93-0916-4b2c-82d1-b2266f79ade0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:38.562710 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d2bcff93-0916-4b2c-82d1-b2266f79ade0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:38.576815 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d2bcff93-0916-4b2c-82d1-b2266f79ade0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.346719 Jul 21 22:34:38.577432 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 93/185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:38 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:39.178784 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6b106196-4017-4ffe-8360-ad7d0c1690f4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:39.180723 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-6b106196-4017-4ffe-8360-ad7d0c1690f4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:39.235961 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b106196-4017-4ffe-8360-ad7d0c1690f4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:39.236775 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b106196-4017-4ffe-8360-ad7d0c1690f4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:39.238242 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b106196-4017-4ffe-8360-ad7d0c1690f4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:39.239043 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b106196-4017-4ffe-8360-ad7d0c1690f4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:39.603717 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-345a80a0-dcf6-46de-b99a-06ea74660b9e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:39.604421 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-345a80a0-dcf6-46de-b99a-06ea74660b9e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:39.612215 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-345a80a0-dcf6-46de-b99a-06ea74660b9e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:39.612651 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-345a80a0-dcf6-46de-b99a-06ea74660b9e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:39.613633 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-345a80a0-dcf6-46de-b99a-06ea74660b9e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:39.614070 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-345a80a0-dcf6-46de-b99a-06ea74660b9e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:39.665797 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6b106196-4017-4ffe-8360-ad7d0c1690f4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:39.674652 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6b106196-4017-4ffe-8360-ad7d0c1690f4 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1367 microversion: 2.1 time: 0.505156 Jul 21 22:34:39.675410 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 93/186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:39 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1367 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:39.916739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-345a80a0-dcf6-46de-b99a-06ea74660b9e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:39.925922 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-345a80a0-dcf6-46de-b99a-06ea74660b9e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.327042 Jul 21 22:34:39.926761 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 94/187] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:39 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:40.569658 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-e9edd8e2-f8b8-4961-9879-893dc7ea8665 req-09606131-c62e-446d-b965-6fb3e927e90a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f", "tag": "f25b0df4-51a9-40a1-a6ef-86df601f88b6"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:40.621450 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-e9edd8e2-f8b8-4961-9879-893dc7ea8665 req-09606131-c62e-446d-b965-6fb3e927e90a service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:40.623669 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-e9edd8e2-f8b8-4961-9879-893dc7ea8665 req-09606131-c62e-446d-b965-6fb3e927e90a service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:40.681613 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-e9edd8e2-f8b8-4961-9879-893dc7ea8665 req-09606131-c62e-446d-b965-6fb3e927e90a service nova] Creating event network-changed:f25b0df4-51a9-40a1-a6ef-86df601f88b6 for instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f on hv-cinder-85069 Jul 21 22:34:40.702213 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-653063d5-bc04-4d91-bea6-d36e10b4af8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:40.711196 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-e9edd8e2-f8b8-4961-9879-893dc7ea8665 req-09606131-c62e-446d-b965-6fb3e927e90a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153609 Jul 21 22:34:40.712104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 94/188] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:40.719457 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-653063d5-bc04-4d91-bea6-d36e10b4af8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:40.752753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-653063d5-bc04-4d91-bea6-d36e10b4af8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:40.757187 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-653063d5-bc04-4d91-bea6-d36e10b4af8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:40.762436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-653063d5-bc04-4d91-bea6-d36e10b4af8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:40.763854 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-653063d5-bc04-4d91-bea6-d36e10b4af8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:40.957248 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8cc7f293-38a1-438c-9411-ecbe6e4f2f3e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:40.958978 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-8cc7f293-38a1-438c-9411-ecbe6e4f2f3e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:40.973156 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8cc7f293-38a1-438c-9411-ecbe6e4f2f3e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:40.974144 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8cc7f293-38a1-438c-9411-ecbe6e4f2f3e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:40.975824 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8cc7f293-38a1-438c-9411-ecbe6e4f2f3e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:40.976792 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8cc7f293-38a1-438c-9411-ecbe6e4f2f3e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:41.268279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-653063d5-bc04-4d91-bea6-d36e10b4af8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:41.288432 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-653063d5-bc04-4d91-bea6-d36e10b4af8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1367 microversion: 2.1 time: 0.597959 Jul 21 22:34:41.290355 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 95/189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:40 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1367 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:41.621906 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8cc7f293-38a1-438c-9411-ecbe6e4f2f3e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:41.641836 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8cc7f293-38a1-438c-9411-ecbe6e4f2f3e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.696250 Jul 21 22:34:41.643148 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 95/190] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:40 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:42.311923 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b4e0a900-f188-4919-96ce-4fb761f675be tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:42.313107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b4e0a900-f188-4919-96ce-4fb761f675be tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:42.327539 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4e0a900-f188-4919-96ce-4fb761f675be tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:42.328891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4e0a900-f188-4919-96ce-4fb761f675be tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:42.332041 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4e0a900-f188-4919-96ce-4fb761f675be tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:42.332838 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4e0a900-f188-4919-96ce-4fb761f675be tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:42.577673 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b4e0a900-f188-4919-96ce-4fb761f675be tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:42.587032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b4e0a900-f188-4919-96ce-4fb761f675be tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1367 microversion: 2.1 time: 0.284060 Jul 21 22:34:42.587739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 96/191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:42 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:42.666277 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3904c349-a151-4774-b527-0a6109637c49 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:42.669254 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3904c349-a151-4774-b527-0a6109637c49 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:42.682940 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3904c349-a151-4774-b527-0a6109637c49 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:42.683967 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3904c349-a151-4774-b527-0a6109637c49 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:42.685544 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3904c349-a151-4774-b527-0a6109637c49 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:42.686444 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3904c349-a151-4774-b527-0a6109637c49 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:42.856586 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3904c349-a151-4774-b527-0a6109637c49 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:42.866254 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3904c349-a151-4774-b527-0a6109637c49 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.209242 Jul 21 22:34:42.869775 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 96/192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:42 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:43.614253 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f6c169a4-1f42-4e1e-9cfb-677f966f6b27 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:43.615495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f6c169a4-1f42-4e1e-9cfb-677f966f6b27 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:43.619088 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=6 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:43.625759 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6c169a4-1f42-4e1e-9cfb-677f966f6b27 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:43.626210 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6c169a4-1f42-4e1e-9cfb-677f966f6b27 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:43.626975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6c169a4-1f42-4e1e-9cfb-677f966f6b27 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:43.627436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6c169a4-1f42-4e1e-9cfb-677f966f6b27 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:43.848294 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f6c169a4-1f42-4e1e-9cfb-677f966f6b27 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:43.860247 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f6c169a4-1f42-4e1e-9cfb-677f966f6b27 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1367 microversion: 2.1 time: 0.256503 Jul 21 22:34:43.872281 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 97/193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:43 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:43.897124 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d570bf0f-2cda-441d-ab41-376205313965 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:43.897672 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d570bf0f-2cda-441d-ab41-376205313965 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:43.900552 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:43.901232 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=6 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:43.908720 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d570bf0f-2cda-441d-ab41-376205313965 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:43.909171 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d570bf0f-2cda-441d-ab41-376205313965 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:43.909958 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d570bf0f-2cda-441d-ab41-376205313965 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:43.910393 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d570bf0f-2cda-441d-ab41-376205313965 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:44.094025 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d570bf0f-2cda-441d-ab41-376205313965 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:44.102488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d570bf0f-2cda-441d-ab41-376205313965 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.209806 Jul 21 22:34:44.113156 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 97/194] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:43 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:44.878653 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4fe35e0e-7a8b-481a-baa6-86090a08019b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:44.879465 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4fe35e0e-7a8b-481a-baa6-86090a08019b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:44.887014 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4fe35e0e-7a8b-481a-baa6-86090a08019b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:44.887489 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4fe35e0e-7a8b-481a-baa6-86090a08019b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:44.888264 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4fe35e0e-7a8b-481a-baa6-86090a08019b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:44.888682 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4fe35e0e-7a8b-481a-baa6-86090a08019b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:45.078776 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4fe35e0e-7a8b-481a-baa6-86090a08019b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:45.087992 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4fe35e0e-7a8b-481a-baa6-86090a08019b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1367 microversion: 2.1 time: 0.213530 Jul 21 22:34:45.088669 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 98/195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:44 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:45.124101 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-491aab2b-17a8-4977-8e7e-67953bee63e7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:45.124893 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-491aab2b-17a8-4977-8e7e-67953bee63e7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:45.137159 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-491aab2b-17a8-4977-8e7e-67953bee63e7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:45.137858 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-491aab2b-17a8-4977-8e7e-67953bee63e7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:45.138795 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-491aab2b-17a8-4977-8e7e-67953bee63e7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:45.139433 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-491aab2b-17a8-4977-8e7e-67953bee63e7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:45.334577 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-491aab2b-17a8-4977-8e7e-67953bee63e7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:45.349578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-491aab2b-17a8-4977-8e7e-67953bee63e7 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.232120 Jul 21 22:34:45.350611 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 98/196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:45 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:46.115953 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-879e176c-1548-4122-8efd-89a79c9a1d1c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:46.116563 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-879e176c-1548-4122-8efd-89a79c9a1d1c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:46.123977 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-879e176c-1548-4122-8efd-89a79c9a1d1c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:46.124431 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-879e176c-1548-4122-8efd-89a79c9a1d1c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:46.125217 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-879e176c-1548-4122-8efd-89a79c9a1d1c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:46.125649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-879e176c-1548-4122-8efd-89a79c9a1d1c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:46.278451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-879e176c-1548-4122-8efd-89a79c9a1d1c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:46.291681 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-879e176c-1548-4122-8efd-89a79c9a1d1c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1367 microversion: 2.1 time: 0.179373 Jul 21 22:34:46.292947 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 99/197] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:46 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:46.371334 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-684cd943-7897-4947-9c0c-d5bc27a1c128 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:46.372374 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-684cd943-7897-4947-9c0c-d5bc27a1c128 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:46.379429 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-684cd943-7897-4947-9c0c-d5bc27a1c128 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:46.379875 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-684cd943-7897-4947-9c0c-d5bc27a1c128 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:46.380865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-684cd943-7897-4947-9c0c-d5bc27a1c128 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:46.381401 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-684cd943-7897-4947-9c0c-d5bc27a1c128 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:46.571322 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-684cd943-7897-4947-9c0c-d5bc27a1c128 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:46.575022 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:46.580336 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-684cd943-7897-4947-9c0c-d5bc27a1c128 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.213053 Jul 21 22:34:46.580976 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 99/198] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:46 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:47.312964 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-62bf98a3-7e57-4e1f-9d2a-24a42fbc2f2a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:47.313564 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-62bf98a3-7e57-4e1f-9d2a-24a42fbc2f2a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:47.321819 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-62bf98a3-7e57-4e1f-9d2a-24a42fbc2f2a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.322290 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-62bf98a3-7e57-4e1f-9d2a-24a42fbc2f2a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:47.323107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-62bf98a3-7e57-4e1f-9d2a-24a42fbc2f2a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.323539 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-62bf98a3-7e57-4e1f-9d2a-24a42fbc2f2a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:47.509743 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-62bf98a3-7e57-4e1f-9d2a-24a42fbc2f2a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:47.517520 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-62bf98a3-7e57-4e1f-9d2a-24a42fbc2f2a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1367 microversion: 2.1 time: 0.208447 Jul 21 22:34:47.518103 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 100/199] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:47 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:47.598907 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4c13642d-6e6e-42de-ad6c-58516014a134 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:47.599574 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4c13642d-6e6e-42de-ad6c-58516014a134 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:47.609595 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4c13642d-6e6e-42de-ad6c-58516014a134 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.610357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-cef33115-b0ff-4cef-b9e3-888a2127f7fe req-47d1a0d4-4efb-4a00-807b-27e546dd261b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f", "name": "network-vif-plugged", "status": "completed", "tag": "f25b0df4-51a9-40a1-a6ef-86df601f88b6"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:47.610507 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4c13642d-6e6e-42de-ad6c-58516014a134 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:47.611276 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4c13642d-6e6e-42de-ad6c-58516014a134 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.611711 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4c13642d-6e6e-42de-ad6c-58516014a134 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:47.631177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-cef33115-b0ff-4cef-b9e3-888a2127f7fe req-47d1a0d4-4efb-4a00-807b-27e546dd261b service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.631965 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-cef33115-b0ff-4cef-b9e3-888a2127f7fe req-47d1a0d4-4efb-4a00-807b-27e546dd261b service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:47.666911 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-cef33115-b0ff-4cef-b9e3-888a2127f7fe req-47d1a0d4-4efb-4a00-807b-27e546dd261b service nova] Creating event network-vif-plugged:f25b0df4-51a9-40a1-a6ef-86df601f88b6 for instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f on hv-cinder-85069 Jul 21 22:34:47.677175 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-cef33115-b0ff-4cef-b9e3-888a2127f7fe req-47d1a0d4-4efb-4a00-807b-27e546dd261b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081375 Jul 21 22:34:47.678387 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 101/200] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:34:47.892792 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4c13642d-6e6e-42de-ad6c-58516014a134 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:47.903488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4c13642d-6e6e-42de-ad6c-58516014a134 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.309407 Jul 21 22:34:47.903995 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 100/201] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:47 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:48.550286 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-07b05684-2ac5-4c35-a08c-baa033f58e69 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:48.550981 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-07b05684-2ac5-4c35-a08c-baa033f58e69 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:48.559198 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07b05684-2ac5-4c35-a08c-baa033f58e69 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:48.559650 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07b05684-2ac5-4c35-a08c-baa033f58e69 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:48.560436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07b05684-2ac5-4c35-a08c-baa033f58e69 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:48.560862 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07b05684-2ac5-4c35-a08c-baa033f58e69 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:48.711968 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-07b05684-2ac5-4c35-a08c-baa033f58e69 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:48.719542 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-07b05684-2ac5-4c35-a08c-baa033f58e69 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1367 microversion: 2.1 time: 0.173457 Jul 21 22:34:48.720120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 102/202] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:48 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:48.922124 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-51e7f6c0-a142-45b3-8504-7911bf2a28de tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:48.923023 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-51e7f6c0-a142-45b3-8504-7911bf2a28de tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:48.932596 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-51e7f6c0-a142-45b3-8504-7911bf2a28de tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:48.933565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-51e7f6c0-a142-45b3-8504-7911bf2a28de tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:48.934370 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-51e7f6c0-a142-45b3-8504-7911bf2a28de tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:48.934854 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-51e7f6c0-a142-45b3-8504-7911bf2a28de tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:49.084247 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-51e7f6c0-a142-45b3-8504-7911bf2a28de tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:49.093209 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-51e7f6c0-a142-45b3-8504-7911bf2a28de tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.175432 Jul 21 22:34:49.093935 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 101/203] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:48 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:49.737823 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1653fd78-b081-48ac-b973-aa5112cbb4a9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:49.738444 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1653fd78-b081-48ac-b973-aa5112cbb4a9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:49.744802 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1653fd78-b081-48ac-b973-aa5112cbb4a9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:49.745315 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1653fd78-b081-48ac-b973-aa5112cbb4a9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:49.746136 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1653fd78-b081-48ac-b973-aa5112cbb4a9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:49.746574 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1653fd78-b081-48ac-b973-aa5112cbb4a9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:49.767517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=100 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:49.910907 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1653fd78-b081-48ac-b973-aa5112cbb4a9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:49.920295 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1653fd78-b081-48ac-b973-aa5112cbb4a9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1557 microversion: 2.1 time: 0.186536 Jul 21 22:34:49.920887 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 103/204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:49 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1557 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:49.939204 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b9fae547-81be-420a-a57d-ad9bbf3733c6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:49.939831 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b9fae547-81be-420a-a57d-ad9bbf3733c6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:49.948306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9fae547-81be-420a-a57d-ad9bbf3733c6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:49.948754 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9fae547-81be-420a-a57d-ad9bbf3733c6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:49.949537 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9fae547-81be-420a-a57d-ad9bbf3733c6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:49.949968 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9fae547-81be-420a-a57d-ad9bbf3733c6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:50.044733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b9fae547-81be-420a-a57d-ad9bbf3733c6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109480 Jul 21 22:34:50.045538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 102/205] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 22:34:49 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:34:50.112540 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d043379f-cff5-4e48-b7af-5016b9ad8100 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:50.113163 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d043379f-cff5-4e48-b7af-5016b9ad8100 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:50.120877 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d043379f-cff5-4e48-b7af-5016b9ad8100 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:50.121322 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d043379f-cff5-4e48-b7af-5016b9ad8100 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:50.122089 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d043379f-cff5-4e48-b7af-5016b9ad8100 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:50.122534 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d043379f-cff5-4e48-b7af-5016b9ad8100 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:50.415277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d043379f-cff5-4e48-b7af-5016b9ad8100 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:50.428668 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d043379f-cff5-4e48-b7af-5016b9ad8100 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.320072 Jul 21 22:34:50.430768 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 104/206] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:50 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:51.322839 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-42fe1216-7b9e-486a-90d3-6ff8449fd424 req-a5002f82-01f6-4700-8e2a-b856652dee90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f", "tag": "f25b0df4-51a9-40a1-a6ef-86df601f88b6"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:51.332223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-42fe1216-7b9e-486a-90d3-6ff8449fd424 req-a5002f82-01f6-4700-8e2a-b856652dee90 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:51.332771 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-42fe1216-7b9e-486a-90d3-6ff8449fd424 req-a5002f82-01f6-4700-8e2a-b856652dee90 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:51.346024 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-42fe1216-7b9e-486a-90d3-6ff8449fd424 req-a5002f82-01f6-4700-8e2a-b856652dee90 service nova] Creating event network-changed:f25b0df4-51a9-40a1-a6ef-86df601f88b6 for instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f on hv-cinder-85069 Jul 21 22:34:51.352678 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-42fe1216-7b9e-486a-90d3-6ff8449fd424 req-a5002f82-01f6-4700-8e2a-b856652dee90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034598 Jul 21 22:34:51.353364 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 103/207] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:34:51.459206 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-832fa7ee-d77a-4e70-963a-381fa503a05d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:51.461481 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-832fa7ee-d77a-4e70-963a-381fa503a05d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:51.471527 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-832fa7ee-d77a-4e70-963a-381fa503a05d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:51.473014 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-832fa7ee-d77a-4e70-963a-381fa503a05d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:51.473928 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-832fa7ee-d77a-4e70-963a-381fa503a05d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:51.474401 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-832fa7ee-d77a-4e70-963a-381fa503a05d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:51.729684 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-832fa7ee-d77a-4e70-963a-381fa503a05d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:51.748615 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-832fa7ee-d77a-4e70-963a-381fa503a05d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.293780 Jul 21 22:34:51.749948 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 105/208] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:51 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:52.141454 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b9afcad3-c594-48bb-8e03-10f8f8888b23 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:52.142305 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b9afcad3-c594-48bb-8e03-10f8f8888b23 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:52.152824 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9afcad3-c594-48bb-8e03-10f8f8888b23 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:52.153713 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9afcad3-c594-48bb-8e03-10f8f8888b23 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:52.154860 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9afcad3-c594-48bb-8e03-10f8f8888b23 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:52.155497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9afcad3-c594-48bb-8e03-10f8f8888b23 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:52.199446 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b9afcad3-c594-48bb-8e03-10f8f8888b23 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/ips" status: 200 len: 144 microversion: 2.1 time: 0.063396 Jul 21 22:34:52.206623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 104/209] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 22:34:52 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/ips => generated 144 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:52.697827 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e481b1db-b00e-4e83-b65c-cde6de6de329 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:52.698896 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e481b1db-b00e-4e83-b65c-cde6de6de329 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:52.705958 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e481b1db-b00e-4e83-b65c-cde6de6de329 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:52.706406 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e481b1db-b00e-4e83-b65c-cde6de6de329 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:52.707223 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e481b1db-b00e-4e83-b65c-cde6de6de329 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:52.707660 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e481b1db-b00e-4e83-b65c-cde6de6de329 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:52.745737 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e481b1db-b00e-4e83-b65c-cde6de6de329 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/ips" status: 200 len: 152 microversion: 2.20 time: 0.053930 Jul 21 22:34:52.746334 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 106/210] 10.222.0.58 () {60 vars in 1288 bytes} [Thu Jul 21 22:34:52 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/ips => generated 152 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:34:52.772538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-86cc1771-8b17-4f41-ad5c-9b5783228d15 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:52.774772 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-86cc1771-8b17-4f41-ad5c-9b5783228d15 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:52.791806 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-86cc1771-8b17-4f41-ad5c-9b5783228d15 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:52.792735 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-86cc1771-8b17-4f41-ad5c-9b5783228d15 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:52.794927 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-86cc1771-8b17-4f41-ad5c-9b5783228d15 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:52.796039 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-86cc1771-8b17-4f41-ad5c-9b5783228d15 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:53.030364 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-86cc1771-8b17-4f41-ad5c-9b5783228d15 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:53.043969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-86cc1771-8b17-4f41-ad5c-9b5783228d15 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.278043 Jul 21 22:34:53.044740 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 105/211] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:52 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:54.069323 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-50e641fa-ee1d-4e0c-aadc-4c18ff2b14e6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:54.070180 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-50e641fa-ee1d-4e0c-aadc-4c18ff2b14e6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:54.077111 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50e641fa-ee1d-4e0c-aadc-4c18ff2b14e6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:54.077554 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50e641fa-ee1d-4e0c-aadc-4c18ff2b14e6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:54.078320 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50e641fa-ee1d-4e0c-aadc-4c18ff2b14e6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:54.078751 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50e641fa-ee1d-4e0c-aadc-4c18ff2b14e6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:54.235179 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-50e641fa-ee1d-4e0c-aadc-4c18ff2b14e6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:54.247502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-50e641fa-ee1d-4e0c-aadc-4c18ff2b14e6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.182493 Jul 21 22:34:54.248292 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 107/212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:54 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:55.265078 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2da7fdbe-f106-4ae9-830d-5781dba5e275 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:55.265679 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2da7fdbe-f106-4ae9-830d-5781dba5e275 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:55.273445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2da7fdbe-f106-4ae9-830d-5781dba5e275 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:55.273445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2da7fdbe-f106-4ae9-830d-5781dba5e275 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:55.274253 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2da7fdbe-f106-4ae9-830d-5781dba5e275 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:55.274689 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2da7fdbe-f106-4ae9-830d-5781dba5e275 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:55.425730 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-2da7fdbe-f106-4ae9-830d-5781dba5e275 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:55.436268 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2da7fdbe-f106-4ae9-830d-5781dba5e275 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.175289 Jul 21 22:34:55.436849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 106/213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:55 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:55.637213 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3c5d1641-e532-497d-b164-fbb0624561a2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:55.637765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3c5d1641-e532-497d-b164-fbb0624561a2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:55.644185 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3c5d1641-e532-497d-b164-fbb0624561a2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:55.644624 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3c5d1641-e532-497d-b164-fbb0624561a2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:55.645667 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3c5d1641-e532-497d-b164-fbb0624561a2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:55.646097 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3c5d1641-e532-497d-b164-fbb0624561a2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:55.672195 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-3c5d1641-e532-497d-b164-fbb0624561a2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lazy-loading 'flavor' on Instance uuid bdafcf28-8b2d-4692-ba35-cd63d2c32de7 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:34:55.978919 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-37a01315-c637-4fd8-b7df-03a9da98fd28 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a46eb20d-5cae-4893-a3ff-942ccf6554ba"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:55.980117 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-37a01315-c637-4fd8-b7df-03a9da98fd28 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:55.986480 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37a01315-c637-4fd8-b7df-03a9da98fd28 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:55.986938 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37a01315-c637-4fd8-b7df-03a9da98fd28 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:55.987766 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37a01315-c637-4fd8-b7df-03a9da98fd28 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:55.988206 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37a01315-c637-4fd8-b7df-03a9da98fd28 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:56.010021 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3c5d1641-e532-497d-b164-fbb0624561a2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "POST /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/action" status: 202 len: 0 microversion: 2.20 time: 0.377656 Jul 21 22:34:56.012599 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 108/214] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jul 21 22:34:55 2022] POST /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:34:56.033011 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d80693dc-2fc3-4382-ba92-93420c48cc1c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:56.033824 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d80693dc-2fc3-4382-ba92-93420c48cc1c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:56.043268 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d80693dc-2fc3-4382-ba92-93420c48cc1c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:56.043817 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d80693dc-2fc3-4382-ba92-93420c48cc1c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:56.044701 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d80693dc-2fc3-4382-ba92-93420c48cc1c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:56.045217 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d80693dc-2fc3-4382-ba92-93420c48cc1c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:56.233767 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d80693dc-2fc3-4382-ba92-93420c48cc1c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:56.249357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d80693dc-2fc3-4382-ba92-93420c48cc1c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:56.255533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d80693dc-2fc3-4382-ba92-93420c48cc1c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:56.257858 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d80693dc-2fc3-4382-ba92-93420c48cc1c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.241020 Jul 21 22:34:56.259559 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 109/215] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:56 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:34:56.438119 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-37a01315-c637-4fd8-b7df-03a9da98fd28 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "POST /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464993 Jul 21 22:34:56.438657 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 107/216] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:34:55 2022] POST /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:56.453823 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cb896a4b-7453-4a82-898c-0611d4b03f48 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:56.454491 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-cb896a4b-7453-4a82-898c-0611d4b03f48 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:56.462281 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cb896a4b-7453-4a82-898c-0611d4b03f48 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:56.462861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cb896a4b-7453-4a82-898c-0611d4b03f48 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:56.463891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cb896a4b-7453-4a82-898c-0611d4b03f48 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:56.464507 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cb896a4b-7453-4a82-898c-0611d4b03f48 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:56.637154 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cb896a4b-7453-4a82-898c-0611d4b03f48 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:56.645663 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-cb896a4b-7453-4a82-898c-0611d4b03f48 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.195582 Jul 21 22:34:56.656423 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 110/217] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:56 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:57.290034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d1f2b2ef-764a-4589-8789-b36c1e4c7ba9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:57.290595 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d1f2b2ef-764a-4589-8789-b36c1e4c7ba9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:57.297175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1f2b2ef-764a-4589-8789-b36c1e4c7ba9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:57.297612 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1f2b2ef-764a-4589-8789-b36c1e4c7ba9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:57.298379 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1f2b2ef-764a-4589-8789-b36c1e4c7ba9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:57.298805 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1f2b2ef-764a-4589-8789-b36c1e4c7ba9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:57.455568 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d1f2b2ef-764a-4589-8789-b36c1e4c7ba9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:57.464259 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d1f2b2ef-764a-4589-8789-b36c1e4c7ba9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:57.465787 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d1f2b2ef-764a-4589-8789-b36c1e4c7ba9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:57.467095 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d1f2b2ef-764a-4589-8789-b36c1e4c7ba9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.182307 Jul 21 22:34:57.467718 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 108/218] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:57 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:57.664686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1991234e-c8bb-49bb-8db2-db1a61320428 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:57.665440 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1991234e-c8bb-49bb-8db2-db1a61320428 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:57.671671 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1991234e-c8bb-49bb-8db2-db1a61320428 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:57.672116 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1991234e-c8bb-49bb-8db2-db1a61320428 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:57.672936 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1991234e-c8bb-49bb-8db2-db1a61320428 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:57.673323 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1991234e-c8bb-49bb-8db2-db1a61320428 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:57.829417 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1991234e-c8bb-49bb-8db2-db1a61320428 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:57.837747 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1991234e-c8bb-49bb-8db2-db1a61320428 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.177767 Jul 21 22:34:57.838328 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 111/219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:57 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:58.486993 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-cc62fbb5-23d0-4e56-ac2a-4bc6f677dbf0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:58.487616 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-cc62fbb5-23d0-4e56-ac2a-4bc6f677dbf0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:58.490073 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:58.496224 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cc62fbb5-23d0-4e56-ac2a-4bc6f677dbf0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:58.496666 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cc62fbb5-23d0-4e56-ac2a-4bc6f677dbf0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:58.497433 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cc62fbb5-23d0-4e56-ac2a-4bc6f677dbf0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:58.497864 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cc62fbb5-23d0-4e56-ac2a-4bc6f677dbf0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:58.650512 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-cc62fbb5-23d0-4e56-ac2a-4bc6f677dbf0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:58.663918 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-cc62fbb5-23d0-4e56-ac2a-4bc6f677dbf0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:58.665279 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-cc62fbb5-23d0-4e56-ac2a-4bc6f677dbf0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:58.666849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-cc62fbb5-23d0-4e56-ac2a-4bc6f677dbf0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.183839 Jul 21 22:34:58.667473 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 109/220] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:58 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:34:58.855675 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-dfe6a593-b20f-470d-bb36-8bc851af2c68 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:58.856407 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-dfe6a593-b20f-470d-bb36-8bc851af2c68 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:58.862094 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dfe6a593-b20f-470d-bb36-8bc851af2c68 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:58.862534 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dfe6a593-b20f-470d-bb36-8bc851af2c68 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:58.863418 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dfe6a593-b20f-470d-bb36-8bc851af2c68 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:58.863867 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dfe6a593-b20f-470d-bb36-8bc851af2c68 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:59.007765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-dfe6a593-b20f-470d-bb36-8bc851af2c68 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:59.015436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-dfe6a593-b20f-470d-bb36-8bc851af2c68 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.164763 Jul 21 22:34:59.016019 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 112/221] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:58 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:59.685698 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-da31b984-fc4a-44ff-93c0-e21083777cfb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:59.686289 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-da31b984-fc4a-44ff-93c0-e21083777cfb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:59.693129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-da31b984-fc4a-44ff-93c0-e21083777cfb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:59.693470 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-da31b984-fc4a-44ff-93c0-e21083777cfb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:59.694250 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-da31b984-fc4a-44ff-93c0-e21083777cfb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:59.695486 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-da31b984-fc4a-44ff-93c0-e21083777cfb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:59.874093 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-da31b984-fc4a-44ff-93c0-e21083777cfb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:59.884436 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-da31b984-fc4a-44ff-93c0-e21083777cfb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:59.885952 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-da31b984-fc4a-44ff-93c0-e21083777cfb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:59.887180 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-da31b984-fc4a-44ff-93c0-e21083777cfb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.205353 Jul 21 22:34:59.887750 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 110/222] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:59 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:00.034364 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0edce513-876d-432f-ac24-4e40cc22e26c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:00.035015 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0edce513-876d-432f-ac24-4e40cc22e26c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:00.044369 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0edce513-876d-432f-ac24-4e40cc22e26c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:00.045188 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0edce513-876d-432f-ac24-4e40cc22e26c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:00.046766 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0edce513-876d-432f-ac24-4e40cc22e26c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:00.048078 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0edce513-876d-432f-ac24-4e40cc22e26c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:00.214896 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-0edce513-876d-432f-ac24-4e40cc22e26c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:00.227559 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0edce513-876d-432f-ac24-4e40cc22e26c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.196593 Jul 21 22:35:00.228574 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 113/223] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:00 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:00.906724 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e7cc7323-a40b-4f78-af55-ecd9d9ff8882 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:00.907511 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e7cc7323-a40b-4f78-af55-ecd9d9ff8882 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:00.914871 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e7cc7323-a40b-4f78-af55-ecd9d9ff8882 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:00.915347 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e7cc7323-a40b-4f78-af55-ecd9d9ff8882 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:00.916347 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e7cc7323-a40b-4f78-af55-ecd9d9ff8882 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:00.916778 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e7cc7323-a40b-4f78-af55-ecd9d9ff8882 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:01.083026 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e7cc7323-a40b-4f78-af55-ecd9d9ff8882 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:01.093027 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e7cc7323-a40b-4f78-af55-ecd9d9ff8882 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:01.094581 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e7cc7323-a40b-4f78-af55-ecd9d9ff8882 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:01.095865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e7cc7323-a40b-4f78-af55-ecd9d9ff8882 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.193176 Jul 21 22:35:01.096358 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 111/224] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:00 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:01.251947 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-66269f14-304d-4fea-a5cb-1e43b7c2d1f5 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:01.252765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-66269f14-304d-4fea-a5cb-1e43b7c2d1f5 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:01.259728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66269f14-304d-4fea-a5cb-1e43b7c2d1f5 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:01.260295 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66269f14-304d-4fea-a5cb-1e43b7c2d1f5 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:01.261170 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66269f14-304d-4fea-a5cb-1e43b7c2d1f5 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:01.261714 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66269f14-304d-4fea-a5cb-1e43b7c2d1f5 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:01.421277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-66269f14-304d-4fea-a5cb-1e43b7c2d1f5 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:01.430203 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-66269f14-304d-4fea-a5cb-1e43b7c2d1f5 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.182061 Jul 21 22:35:01.431040 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 114/225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:01 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:02.115824 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-717678f7-6d31-4c99-87b4-85ccc061b6dc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:02.117219 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-717678f7-6d31-4c99-87b4-85ccc061b6dc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:02.126282 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-717678f7-6d31-4c99-87b4-85ccc061b6dc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:02.126829 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-717678f7-6d31-4c99-87b4-85ccc061b6dc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:02.127837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-717678f7-6d31-4c99-87b4-85ccc061b6dc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:02.128376 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-717678f7-6d31-4c99-87b4-85ccc061b6dc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:02.386417 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-717678f7-6d31-4c99-87b4-85ccc061b6dc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:02.401028 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-717678f7-6d31-4c99-87b4-85ccc061b6dc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:02.404390 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-717678f7-6d31-4c99-87b4-85ccc061b6dc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:02.406889 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-717678f7-6d31-4c99-87b4-85ccc061b6dc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.295681 Jul 21 22:35:02.408251 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 112/226] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:02 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:02.452759 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7ad2bec0-b8b7-427e-8dc6-ba348f6285b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:02.453868 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7ad2bec0-b8b7-427e-8dc6-ba348f6285b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:02.465826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ad2bec0-b8b7-427e-8dc6-ba348f6285b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:02.466639 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ad2bec0-b8b7-427e-8dc6-ba348f6285b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:02.468203 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ad2bec0-b8b7-427e-8dc6-ba348f6285b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:02.468983 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ad2bec0-b8b7-427e-8dc6-ba348f6285b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:02.736554 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7ad2bec0-b8b7-427e-8dc6-ba348f6285b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:02.748920 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7ad2bec0-b8b7-427e-8dc6-ba348f6285b8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.303957 Jul 21 22:35:02.764321 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 115/227] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:02 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:03.440385 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-31d12e1f-4c7d-4d42-955e-3dd48dd260eb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:03.443133 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-31d12e1f-4c7d-4d42-955e-3dd48dd260eb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:03.454643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-31d12e1f-4c7d-4d42-955e-3dd48dd260eb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:03.455509 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-31d12e1f-4c7d-4d42-955e-3dd48dd260eb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:03.456770 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-31d12e1f-4c7d-4d42-955e-3dd48dd260eb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:03.457473 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-31d12e1f-4c7d-4d42-955e-3dd48dd260eb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:03.651355 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-31d12e1f-4c7d-4d42-955e-3dd48dd260eb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:03.665069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-31d12e1f-4c7d-4d42-955e-3dd48dd260eb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:03.667416 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-31d12e1f-4c7d-4d42-955e-3dd48dd260eb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:03.668695 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-31d12e1f-4c7d-4d42-955e-3dd48dd260eb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.235002 Jul 21 22:35:03.669271 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 113/228] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:03 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:03.776220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4bde4ba7-5b40-433f-8673-0766f09e8224 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:03.777334 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4bde4ba7-5b40-433f-8673-0766f09e8224 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:03.780537 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=58 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:03.795096 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4bde4ba7-5b40-433f-8673-0766f09e8224 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:03.796593 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4bde4ba7-5b40-433f-8673-0766f09e8224 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:03.797748 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4bde4ba7-5b40-433f-8673-0766f09e8224 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:03.798272 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4bde4ba7-5b40-433f-8673-0766f09e8224 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:04.003950 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4bde4ba7-5b40-433f-8673-0766f09e8224 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:04.018807 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4bde4ba7-5b40-433f-8673-0766f09e8224 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.250471 Jul 21 22:35:04.019385 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 116/229] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:03 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:04.165097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c77ef5f9-4762-45e1-adb0-dc4fce02dbaa tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:04.172176 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c77ef5f9-4762-45e1-adb0-dc4fce02dbaa tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:04.172617 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c77ef5f9-4762-45e1-adb0-dc4fce02dbaa tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:04.389034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c77ef5f9-4762-45e1-adb0-dc4fce02dbaa tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Going to try to stop instance {{(pid=124497) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 22:35:04.469157 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c77ef5f9-4762-45e1-adb0-dc4fce02dbaa tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "POST /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/action" status: 202 len: 0 microversion: 2.1 time: 0.308789 Jul 21 22:35:04.471628 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 114/230] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:35:04 2022] POST /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:35:04.491943 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-468a38c3-3927-4631-b851-6e49e0d326f6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:04.494514 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-468a38c3-3927-4631-b851-6e49e0d326f6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:04.504864 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-468a38c3-3927-4631-b851-6e49e0d326f6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:04.506371 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-468a38c3-3927-4631-b851-6e49e0d326f6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:04.509158 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-468a38c3-3927-4631-b851-6e49e0d326f6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:04.510874 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-468a38c3-3927-4631-b851-6e49e0d326f6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:04.698125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c9d28238-55e9-460d-ab1a-b1a3461dd402 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:04.699411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c9d28238-55e9-460d-ab1a-b1a3461dd402 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:04.706797 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c9d28238-55e9-460d-ab1a-b1a3461dd402 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:04.707624 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c9d28238-55e9-460d-ab1a-b1a3461dd402 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:04.708708 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c9d28238-55e9-460d-ab1a-b1a3461dd402 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:04.709388 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c9d28238-55e9-460d-ab1a-b1a3461dd402 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:04.748289 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:05.074571 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-468a38c3-3927-4631-b851-6e49e0d326f6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:05.087965 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-468a38c3-3927-4631-b851-6e49e0d326f6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1722 microversion: 2.1 time: 0.610233 Jul 21 22:35:05.099311 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 117/231] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:04 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1722 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:05.100097 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-aa29295b-bfe1-4285-a0ac-abce6a3032d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:05.101650 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-aa29295b-bfe1-4285-a0ac-abce6a3032d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:05.114220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aa29295b-bfe1-4285-a0ac-abce6a3032d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:05.115361 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aa29295b-bfe1-4285-a0ac-abce6a3032d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:05.118973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aa29295b-bfe1-4285-a0ac-abce6a3032d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:05.120102 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-aa29295b-bfe1-4285-a0ac-abce6a3032d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:05.170426 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:05.202962 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c9d28238-55e9-460d-ab1a-b1a3461dd402 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:05.225089 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c9d28238-55e9-460d-ab1a-b1a3461dd402 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:05.233041 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c9d28238-55e9-460d-ab1a-b1a3461dd402 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:05.242917 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c9d28238-55e9-460d-ab1a-b1a3461dd402 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.544586 Jul 21 22:35:05.244665 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 115/232] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:04 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:05.500869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-aa29295b-bfe1-4285-a0ac-abce6a3032d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:05.516501 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-aa29295b-bfe1-4285-a0ac-abce6a3032d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.423154 Jul 21 22:35:05.517669 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 118/233] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:05 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:06.119654 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-aeb5e98f-ec32-4de9-94e3-614190e7f0f7 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:06.120452 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-aeb5e98f-ec32-4de9-94e3-614190e7f0f7 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:06.129575 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aeb5e98f-ec32-4de9-94e3-614190e7f0f7 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:06.130385 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aeb5e98f-ec32-4de9-94e3-614190e7f0f7 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:06.132426 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aeb5e98f-ec32-4de9-94e3-614190e7f0f7 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:06.133513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aeb5e98f-ec32-4de9-94e3-614190e7f0f7 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:06.274232 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-841cafbb-e48e-4765-ba9b-c158d1a0e266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:06.275953 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-841cafbb-e48e-4765-ba9b-c158d1a0e266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:06.291779 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-841cafbb-e48e-4765-ba9b-c158d1a0e266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:06.292932 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-841cafbb-e48e-4765-ba9b-c158d1a0e266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:06.294840 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-841cafbb-e48e-4765-ba9b-c158d1a0e266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:06.295974 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-841cafbb-e48e-4765-ba9b-c158d1a0e266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:06.513328 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-aeb5e98f-ec32-4de9-94e3-614190e7f0f7 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:06.528974 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-aeb5e98f-ec32-4de9-94e3-614190e7f0f7 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1722 microversion: 2.1 time: 0.413005 Jul 21 22:35:06.530313 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 116/234] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:06 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:06.550414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9fe50c38-0570-4393-bb63-5031cffa19a6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:06.552030 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-9fe50c38-0570-4393-bb63-5031cffa19a6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:06.562633 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9fe50c38-0570-4393-bb63-5031cffa19a6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:06.564088 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9fe50c38-0570-4393-bb63-5031cffa19a6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:06.565824 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9fe50c38-0570-4393-bb63-5031cffa19a6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:06.566787 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9fe50c38-0570-4393-bb63-5031cffa19a6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:06.664337 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-841cafbb-e48e-4765-ba9b-c158d1a0e266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:06.673147 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-841cafbb-e48e-4765-ba9b-c158d1a0e266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:06.674980 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-841cafbb-e48e-4765-ba9b-c158d1a0e266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:06.677360 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-841cafbb-e48e-4765-ba9b-c158d1a0e266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.414294 Jul 21 22:35:06.678936 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 119/235] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:06 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:06.858531 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-9fe50c38-0570-4393-bb63-5031cffa19a6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:06.877337 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-9fe50c38-0570-4393-bb63-5031cffa19a6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.333379 Jul 21 22:35:06.879906 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 117/236] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:06 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:07.561117 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-bf0f1486-4132-4c52-8e20-8f10e3c6755b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:07.562290 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-bf0f1486-4132-4c52-8e20-8f10e3c6755b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:07.570593 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bf0f1486-4132-4c52-8e20-8f10e3c6755b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:07.571573 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bf0f1486-4132-4c52-8e20-8f10e3c6755b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:07.572561 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bf0f1486-4132-4c52-8e20-8f10e3c6755b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:07.573162 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bf0f1486-4132-4c52-8e20-8f10e3c6755b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:07.698018 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c2c6be27-3096-46dc-bc97-3dd27ba53f70 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:07.698881 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c2c6be27-3096-46dc-bc97-3dd27ba53f70 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:07.713768 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c2c6be27-3096-46dc-bc97-3dd27ba53f70 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:07.719479 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c2c6be27-3096-46dc-bc97-3dd27ba53f70 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:07.729183 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c2c6be27-3096-46dc-bc97-3dd27ba53f70 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:07.730474 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c2c6be27-3096-46dc-bc97-3dd27ba53f70 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:08.196559 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-bf0f1486-4132-4c52-8e20-8f10e3c6755b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:08.217856 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-bf0f1486-4132-4c52-8e20-8f10e3c6755b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1722 microversion: 2.1 time: 0.669920 Jul 21 22:35:08.219398 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 120/237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:07 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1722 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:08.235456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c3b36bac-3553-4c54-8eff-176d5bcc267f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:08.236579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c3b36bac-3553-4c54-8eff-176d5bcc267f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:08.248056 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c3b36bac-3553-4c54-8eff-176d5bcc267f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:08.249227 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c3b36bac-3553-4c54-8eff-176d5bcc267f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:08.250585 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c3b36bac-3553-4c54-8eff-176d5bcc267f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:08.251341 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c3b36bac-3553-4c54-8eff-176d5bcc267f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:08.262560 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c2c6be27-3096-46dc-bc97-3dd27ba53f70 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:08.283701 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c2c6be27-3096-46dc-bc97-3dd27ba53f70 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:08.285674 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c2c6be27-3096-46dc-bc97-3dd27ba53f70 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:08.287195 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c2c6be27-3096-46dc-bc97-3dd27ba53f70 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.593818 Jul 21 22:35:08.288463 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 118/238] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:07 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:08.513309 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c3b36bac-3553-4c54-8eff-176d5bcc267f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:08.525939 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c3b36bac-3553-4c54-8eff-176d5bcc267f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.304828 Jul 21 22:35:08.532844 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 121/239] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:08 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:09.243201 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6754bbb2-c8ac-4d63-bef7-443ee9307dbf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:09.243953 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-6754bbb2-c8ac-4d63-bef7-443ee9307dbf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:09.251349 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6754bbb2-c8ac-4d63-bef7-443ee9307dbf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:09.252165 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6754bbb2-c8ac-4d63-bef7-443ee9307dbf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:09.253063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6754bbb2-c8ac-4d63-bef7-443ee9307dbf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:09.253722 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6754bbb2-c8ac-4d63-bef7-443ee9307dbf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:09.314822 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-00f494cc-3a9f-4fd7-8b75-88541e06f1ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:09.316509 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-00f494cc-3a9f-4fd7-8b75-88541e06f1ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:09.347710 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-00f494cc-3a9f-4fd7-8b75-88541e06f1ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:09.349048 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-00f494cc-3a9f-4fd7-8b75-88541e06f1ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:09.350043 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-00f494cc-3a9f-4fd7-8b75-88541e06f1ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:09.356135 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-00f494cc-3a9f-4fd7-8b75-88541e06f1ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:09.531352 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6754bbb2-c8ac-4d63-bef7-443ee9307dbf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:09.541281 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6754bbb2-c8ac-4d63-bef7-443ee9307dbf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1722 microversion: 2.1 time: 0.303493 Jul 21 22:35:09.551671 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 119/240] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:09 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:09.564536 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-433ee0ef-95cc-4d19-8ce1-389b83e90e1a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:09.565390 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-433ee0ef-95cc-4d19-8ce1-389b83e90e1a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:09.573597 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-433ee0ef-95cc-4d19-8ce1-389b83e90e1a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:09.574313 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-433ee0ef-95cc-4d19-8ce1-389b83e90e1a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:09.575861 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-433ee0ef-95cc-4d19-8ce1-389b83e90e1a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:09.576473 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-433ee0ef-95cc-4d19-8ce1-389b83e90e1a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:09.628150 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-00f494cc-3a9f-4fd7-8b75-88541e06f1ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:09.637916 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-00f494cc-3a9f-4fd7-8b75-88541e06f1ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:09.639727 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-00f494cc-3a9f-4fd7-8b75-88541e06f1ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:09.641047 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-00f494cc-3a9f-4fd7-8b75-88541e06f1ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.330911 Jul 21 22:35:09.641743 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 122/241] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:09 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:09.769025 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-433ee0ef-95cc-4d19-8ce1-389b83e90e1a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:09.789955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-433ee0ef-95cc-4d19-8ce1-389b83e90e1a tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.236156 Jul 21 22:35:09.792785 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 120/242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:09 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:10.561199 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5d338af7-1164-44f9-9375-4dffd71b7633 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:10.561999 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-5d338af7-1164-44f9-9375-4dffd71b7633 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:10.575711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d338af7-1164-44f9-9375-4dffd71b7633 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:10.577881 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d338af7-1164-44f9-9375-4dffd71b7633 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:10.578882 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d338af7-1164-44f9-9375-4dffd71b7633 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:10.581442 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d338af7-1164-44f9-9375-4dffd71b7633 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:10.672400 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8ac47b48-326e-4e84-b50c-6761b5d5cd3c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:10.675819 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-8ac47b48-326e-4e84-b50c-6761b5d5cd3c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:10.687117 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8ac47b48-326e-4e84-b50c-6761b5d5cd3c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:10.688118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8ac47b48-326e-4e84-b50c-6761b5d5cd3c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:10.689437 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8ac47b48-326e-4e84-b50c-6761b5d5cd3c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:10.690194 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8ac47b48-326e-4e84-b50c-6761b5d5cd3c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:11.009453 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5d338af7-1164-44f9-9375-4dffd71b7633 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:11.018828 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5d338af7-1164-44f9-9375-4dffd71b7633 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1722 microversion: 2.1 time: 0.462324 Jul 21 22:35:11.020329 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 123/243] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:10 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1722 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:11.031771 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-817dd9e9-51f4-4aa5-9836-ba6fba5fdd5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:11.032699 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-817dd9e9-51f4-4aa5-9836-ba6fba5fdd5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:11.055515 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-817dd9e9-51f4-4aa5-9836-ba6fba5fdd5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:11.056524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-817dd9e9-51f4-4aa5-9836-ba6fba5fdd5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:11.058049 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-817dd9e9-51f4-4aa5-9836-ba6fba5fdd5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:11.059022 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-817dd9e9-51f4-4aa5-9836-ba6fba5fdd5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:11.175145 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8ac47b48-326e-4e84-b50c-6761b5d5cd3c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:11.197921 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8ac47b48-326e-4e84-b50c-6761b5d5cd3c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:11.202803 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8ac47b48-326e-4e84-b50c-6761b5d5cd3c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:11.205878 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8ac47b48-326e-4e84-b50c-6761b5d5cd3c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.546458 Jul 21 22:35:11.210717 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 121/244] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:10 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:11.355776 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-817dd9e9-51f4-4aa5-9836-ba6fba5fdd5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:11.373923 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-817dd9e9-51f4-4aa5-9836-ba6fba5fdd5c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1502 microversion: 2.1 time: 0.352057 Jul 21 22:35:11.390840 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 124/245] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:11 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1502 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:11.397740 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-50a2a3fe-e6b7-4a3d-87e7-2c6020e731f3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aa4a6ac-87ff-4b73-a471-a5f4e61ef362"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:11.400253 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-50a2a3fe-e6b7-4a3d-87e7-2c6020e731f3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:11.412359 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-50a2a3fe-e6b7-4a3d-87e7-2c6020e731f3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:11.412998 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-50a2a3fe-e6b7-4a3d-87e7-2c6020e731f3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:11.414021 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-50a2a3fe-e6b7-4a3d-87e7-2c6020e731f3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:11.414467 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-50a2a3fe-e6b7-4a3d-87e7-2c6020e731f3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:11.455185 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-50a2a3fe-e6b7-4a3d-87e7-2c6020e731f3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] HTTP exception thrown: Cannot 'attach_volume' instance 967535ed-7748-4181-a946-d67bfbb813d0 while it is in vm_state rescued Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-50a2a3fe-e6b7-4a3d-87e7-2c6020e731f3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Request method failure captured: Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: POST /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0/os-volume_attachments HTTP/1.1 Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 74 Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQcy_G8ocjTOCjKfuQiJgav55FcHkpRzXV2eQjXzWDayGJS8w3BYSyBfL-Cs1UDOIt1B3j3O6nqOG9p2BeXrgzNDFMGpTB6FKm7m_uSZW9Uo2VLu24MyVG3Pb1Z8P536qLitexREcsNaSkF2h16ltZ1uA89QIYJo0KijJzLAxeNAN0 Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 3138cf3bb8a24ba19295565fca0a471e Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:35:11.457252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3138cf3bb8a24ba19295565fca0a471e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 3138cf3bb8a24ba19295565fca0a471e Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-ServerRescueNegativeTestJSON-1702913491-project Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: cf3fd4428e3b46cd9e83e1d32571097b Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1702913491-project Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {"volumeAttachment": {"volumeId": "4aa4a6ac-87ff-4b73-a471-a5f4e61ef362"}} Jul 21 22:35:11.458494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Cannot 'attach_volume' instance 967535ed-7748-4181-a946-d67bfbb813d0 while it is in vm_state rescued Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'server_id': '967535ed-7748-4181-a946-d67bfbb813d0', 'body': {'volumeAttachment': {'volumeId': '4aa4a6ac-87ff-4b73-a471-a5f4e61ef362'}}} Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 967535ed-7748-4181-a946-d67bfbb813d0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:35:11.459227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 967535ed-7748-4181-a946-d67bfbb813d0 while it is in vm_state rescued Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:11.461434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:11.462461 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:35:11.462461 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:35:11.462461 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 967535ed-7748-4181-a946-d67bfbb813d0 while it is in vm_state rescued Jul 21 22:35:11.462461 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:35:11.463864 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-50a2a3fe-e6b7-4a3d-87e7-2c6020e731f3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Returning 409 to user: Cannot 'attach_volume' instance 967535ed-7748-4181-a946-d67bfbb813d0 while it is in vm_state rescued {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:35:11.464944 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-50a2a3fe-e6b7-4a3d-87e7-2c6020e731f3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "POST /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.076808 Jul 21 22:35:11.465549 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 122/246] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:35:11 2022] POST /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0/os-volume_attachments => generated 152 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 22:35:11.477695 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c8fb2768-d172-4321-bcfe-b1491e44a057 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:11.478641 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c8fb2768-d172-4321-bcfe-b1491e44a057 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:11.487574 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c8fb2768-d172-4321-bcfe-b1491e44a057 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:11.491640 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c8fb2768-d172-4321-bcfe-b1491e44a057 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:11.494016 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c8fb2768-d172-4321-bcfe-b1491e44a057 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:11.496643 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c8fb2768-d172-4321-bcfe-b1491e44a057 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:11.598383 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c8fb2768-d172-4321-bcfe-b1491e44a057 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "POST /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0/action" status: 202 len: 0 microversion: 2.1 time: 0.126052 Jul 21 22:35:11.601219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 125/247] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:35:11 2022] POST /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:35:11.610204 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-72ca22ed-c078-4ba2-b8c1-61a687d3b16d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:11.610848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-72ca22ed-c078-4ba2-b8c1-61a687d3b16d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:11.622086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72ca22ed-c078-4ba2-b8c1-61a687d3b16d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:11.622544 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72ca22ed-c078-4ba2-b8c1-61a687d3b16d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:11.623360 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72ca22ed-c078-4ba2-b8c1-61a687d3b16d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:11.623978 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72ca22ed-c078-4ba2-b8c1-61a687d3b16d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:12.048612 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a6941edd-844a-4c58-9dff-abd317f12f13 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:12.051035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a6941edd-844a-4c58-9dff-abd317f12f13 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:12.088136 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a6941edd-844a-4c58-9dff-abd317f12f13 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:12.089173 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a6941edd-844a-4c58-9dff-abd317f12f13 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:12.090971 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a6941edd-844a-4c58-9dff-abd317f12f13 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:12.091884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a6941edd-844a-4c58-9dff-abd317f12f13 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:12.187468 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-72ca22ed-c078-4ba2-b8c1-61a687d3b16d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:12.204785 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-72ca22ed-c078-4ba2-b8c1-61a687d3b16d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1510 microversion: 2.1 time: 0.598570 Jul 21 22:35:12.205744 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 123/248] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:11 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1510 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:12.228424 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8759d1c5-5a11-4bc9-ab54-786e1212da8e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:12.229039 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-8759d1c5-5a11-4bc9-ab54-786e1212da8e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:12.242987 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8759d1c5-5a11-4bc9-ab54-786e1212da8e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:12.243479 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8759d1c5-5a11-4bc9-ab54-786e1212da8e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:12.244294 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8759d1c5-5a11-4bc9-ab54-786e1212da8e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:12.244739 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8759d1c5-5a11-4bc9-ab54-786e1212da8e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:12.556065 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a6941edd-844a-4c58-9dff-abd317f12f13 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:12.574868 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a6941edd-844a-4c58-9dff-abd317f12f13 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1722 microversion: 2.1 time: 0.536382 Jul 21 22:35:12.589391 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 126/249] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:12 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1722 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:12.710631 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8759d1c5-5a11-4bc9-ab54-786e1212da8e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:12.733476 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8759d1c5-5a11-4bc9-ab54-786e1212da8e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:12.740293 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8759d1c5-5a11-4bc9-ab54-786e1212da8e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:12.743343 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8759d1c5-5a11-4bc9-ab54-786e1212da8e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1744 microversion: 2.20 time: 0.519099 Jul 21 22:35:12.744394 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 124/250] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:12 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1744 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:13.224985 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-eb635b15-c875-4d8a-9562-d3858eaae1f6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:13.225808 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-eb635b15-c875-4d8a-9562-d3858eaae1f6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:13.241413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-eb635b15-c875-4d8a-9562-d3858eaae1f6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:13.242262 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-eb635b15-c875-4d8a-9562-d3858eaae1f6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:13.243441 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-eb635b15-c875-4d8a-9562-d3858eaae1f6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:13.244104 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-eb635b15-c875-4d8a-9562-d3858eaae1f6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:13.563990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-eb635b15-c875-4d8a-9562-d3858eaae1f6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:13.577793 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-eb635b15-c875-4d8a-9562-d3858eaae1f6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1510 microversion: 2.1 time: 0.357137 Jul 21 22:35:13.578393 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 127/251] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:13 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1510 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:13.612209 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c918b0c6-bc31-4dad-97e3-7c4574ca33e3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:13.613308 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c918b0c6-bc31-4dad-97e3-7c4574ca33e3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:13.634248 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c918b0c6-bc31-4dad-97e3-7c4574ca33e3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:13.634779 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c918b0c6-bc31-4dad-97e3-7c4574ca33e3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:13.635670 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c918b0c6-bc31-4dad-97e3-7c4574ca33e3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:13.637005 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c918b0c6-bc31-4dad-97e3-7c4574ca33e3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:13.777553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ddb1cfe8-a936-4508-a268-a8a5c15406b5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:13.778545 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ddb1cfe8-a936-4508-a268-a8a5c15406b5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:13.786254 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ddb1cfe8-a936-4508-a268-a8a5c15406b5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:13.787244 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ddb1cfe8-a936-4508-a268-a8a5c15406b5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:13.788918 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ddb1cfe8-a936-4508-a268-a8a5c15406b5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:13.789594 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ddb1cfe8-a936-4508-a268-a8a5c15406b5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:14.062540 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c918b0c6-bc31-4dad-97e3-7c4574ca33e3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:14.081119 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c918b0c6-bc31-4dad-97e3-7c4574ca33e3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1722 microversion: 2.1 time: 0.481894 Jul 21 22:35:14.082699 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 125/252] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:13 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1722 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:14.133639 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ddb1cfe8-a936-4508-a268-a8a5c15406b5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:14.148467 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ddb1cfe8-a936-4508-a268-a8a5c15406b5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:14.151179 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ddb1cfe8-a936-4508-a268-a8a5c15406b5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:14.153537 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ddb1cfe8-a936-4508-a268-a8a5c15406b5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1744 microversion: 2.20 time: 0.380775 Jul 21 22:35:14.155263 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 128/253] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:13 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1744 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:14.611290 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-dd672b9f-6f10-46c3-9cdf-8e9bdabd1906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:14.612942 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-dd672b9f-6f10-46c3-9cdf-8e9bdabd1906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:14.625501 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd672b9f-6f10-46c3-9cdf-8e9bdabd1906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:14.626522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd672b9f-6f10-46c3-9cdf-8e9bdabd1906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:14.629056 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd672b9f-6f10-46c3-9cdf-8e9bdabd1906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:14.629831 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dd672b9f-6f10-46c3-9cdf-8e9bdabd1906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:14.973923 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-dd672b9f-6f10-46c3-9cdf-8e9bdabd1906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:14.989474 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-dd672b9f-6f10-46c3-9cdf-8e9bdabd1906 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1510 microversion: 2.1 time: 0.385910 Jul 21 22:35:14.997610 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 126/254] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:14 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1510 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:15.116660 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a7c2e7d9-1951-491e-8466-c05e1ec8b351 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:15.118612 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a7c2e7d9-1951-491e-8466-c05e1ec8b351 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:15.132918 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a7c2e7d9-1951-491e-8466-c05e1ec8b351 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:15.133581 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a7c2e7d9-1951-491e-8466-c05e1ec8b351 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:15.135278 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a7c2e7d9-1951-491e-8466-c05e1ec8b351 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:15.136950 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a7c2e7d9-1951-491e-8466-c05e1ec8b351 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:15.177112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b1e1885c-69c6-4e0a-9dfc-8f65e809d4c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:15.178093 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b1e1885c-69c6-4e0a-9dfc-8f65e809d4c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:15.185002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b1e1885c-69c6-4e0a-9dfc-8f65e809d4c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:15.186077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b1e1885c-69c6-4e0a-9dfc-8f65e809d4c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:15.187070 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b1e1885c-69c6-4e0a-9dfc-8f65e809d4c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:15.187904 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b1e1885c-69c6-4e0a-9dfc-8f65e809d4c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:15.605631 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a7c2e7d9-1951-491e-8466-c05e1ec8b351 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:15.619860 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a7c2e7d9-1951-491e-8466-c05e1ec8b351 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1722 microversion: 2.1 time: 0.512399 Jul 21 22:35:15.620884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 129/255] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:15 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1722 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:15.627825 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b1e1885c-69c6-4e0a-9dfc-8f65e809d4c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:15.642928 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b1e1885c-69c6-4e0a-9dfc-8f65e809d4c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:15.645164 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b1e1885c-69c6-4e0a-9dfc-8f65e809d4c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:15.646619 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b1e1885c-69c6-4e0a-9dfc-8f65e809d4c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1744 microversion: 2.20 time: 0.473994 Jul 21 22:35:15.651111 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 127/256] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:15 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1744 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:16.008903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e56cf22a-665f-4171-b212-caa05ec72a41 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:16.009880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e56cf22a-665f-4171-b212-caa05ec72a41 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:16.027699 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e56cf22a-665f-4171-b212-caa05ec72a41 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:16.030005 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e56cf22a-665f-4171-b212-caa05ec72a41 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:16.032391 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e56cf22a-665f-4171-b212-caa05ec72a41 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:16.043771 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e56cf22a-665f-4171-b212-caa05ec72a41 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:16.307530 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e56cf22a-665f-4171-b212-caa05ec72a41 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:16.353364 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e56cf22a-665f-4171-b212-caa05ec72a41 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1510 microversion: 2.1 time: 0.348465 Jul 21 22:35:16.355350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 130/257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:16 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:16.644170 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6b6fe047-ff35-41f7-9973-82e0ea36c8b6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:16.646863 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-6b6fe047-ff35-41f7-9973-82e0ea36c8b6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:16.674691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2dcf1bc4-131e-4228-8b09-d4731cef8cb8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:16.679340 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2dcf1bc4-131e-4228-8b09-d4731cef8cb8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:16.691188 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b6fe047-ff35-41f7-9973-82e0ea36c8b6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:16.691866 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b6fe047-ff35-41f7-9973-82e0ea36c8b6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:16.692725 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b6fe047-ff35-41f7-9973-82e0ea36c8b6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:16.693171 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b6fe047-ff35-41f7-9973-82e0ea36c8b6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:16.702970 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2dcf1bc4-131e-4228-8b09-d4731cef8cb8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:16.703448 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2dcf1bc4-131e-4228-8b09-d4731cef8cb8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:16.704428 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2dcf1bc4-131e-4228-8b09-d4731cef8cb8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:16.705039 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2dcf1bc4-131e-4228-8b09-d4731cef8cb8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:16.981733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6b6fe047-ff35-41f7-9973-82e0ea36c8b6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:16.990335 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2dcf1bc4-131e-4228-8b09-d4731cef8cb8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:16.991894 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6b6fe047-ff35-41f7-9973-82e0ea36c8b6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1722 microversion: 2.1 time: 0.357400 Jul 21 22:35:17.001772 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 128/258] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:16 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:17.002749 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2dcf1bc4-131e-4228-8b09-d4731cef8cb8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:17.004465 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2dcf1bc4-131e-4228-8b09-d4731cef8cb8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:17.005839 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2dcf1bc4-131e-4228-8b09-d4731cef8cb8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1744 microversion: 2.20 time: 0.343600 Jul 21 22:35:17.007226 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 131/259] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:16 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1744 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:17.375968 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8179de11-431b-4d6d-bd01-308c860a141d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:17.376996 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-8179de11-431b-4d6d-bd01-308c860a141d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:17.386644 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8179de11-431b-4d6d-bd01-308c860a141d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:17.387360 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8179de11-431b-4d6d-bd01-308c860a141d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:17.388371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8179de11-431b-4d6d-bd01-308c860a141d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:17.388845 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8179de11-431b-4d6d-bd01-308c860a141d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:17.558100 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8179de11-431b-4d6d-bd01-308c860a141d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:17.568390 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8179de11-431b-4d6d-bd01-308c860a141d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1510 microversion: 2.1 time: 0.198908 Jul 21 22:35:17.570740 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 129/260] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:17 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:18.014974 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b61c3141-dcd6-4f5d-8c28-7ba57e63a845 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:18.020141 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b61c3141-dcd6-4f5d-8c28-7ba57e63a845 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:18.028660 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-058486b9-5479-4f3e-ab6c-ffd3e8fab22c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:18.030506 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-058486b9-5479-4f3e-ab6c-ffd3e8fab22c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:18.051283 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-058486b9-5479-4f3e-ab6c-ffd3e8fab22c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:18.054467 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b61c3141-dcd6-4f5d-8c28-7ba57e63a845 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:18.057957 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-058486b9-5479-4f3e-ab6c-ffd3e8fab22c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:18.059292 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b61c3141-dcd6-4f5d-8c28-7ba57e63a845 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:18.060974 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-058486b9-5479-4f3e-ab6c-ffd3e8fab22c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:18.066955 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b61c3141-dcd6-4f5d-8c28-7ba57e63a845 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:18.071558 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-058486b9-5479-4f3e-ab6c-ffd3e8fab22c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:18.072825 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b61c3141-dcd6-4f5d-8c28-7ba57e63a845 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:18.628459 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-058486b9-5479-4f3e-ab6c-ffd3e8fab22c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:18.643662 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b61c3141-dcd6-4f5d-8c28-7ba57e63a845 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:18.649001 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-058486b9-5479-4f3e-ab6c-ffd3e8fab22c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:18.659975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b61c3141-dcd6-4f5d-8c28-7ba57e63a845 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1722 microversion: 2.1 time: 0.652436 Jul 21 22:35:18.661129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-058486b9-5479-4f3e-ab6c-ffd3e8fab22c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:18.676787 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-058486b9-5479-4f3e-ab6c-ffd3e8fab22c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1744 microversion: 2.20 time: 0.643603 Jul 21 22:35:18.676787 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 130/261] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:18 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1744 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:18.677650 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 132/262] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:18 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1722 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:18.703291 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3385371b-94f8-4e81-b2a8-2d9a16ede57d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:18.703857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3385371b-94f8-4e81-b2a8-2d9a16ede57d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:18.746520 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3385371b-94f8-4e81-b2a8-2d9a16ede57d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:18.749721 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3385371b-94f8-4e81-b2a8-2d9a16ede57d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:18.752007 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3385371b-94f8-4e81-b2a8-2d9a16ede57d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:18.755400 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3385371b-94f8-4e81-b2a8-2d9a16ede57d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.030945 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3385371b-94f8-4e81-b2a8-2d9a16ede57d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:19.041898 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3385371b-94f8-4e81-b2a8-2d9a16ede57d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1516 microversion: 2.1 time: 0.369613 Jul 21 22:35:19.043299 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 131/263] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:18 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1516 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:19.344415 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-48de3d59-6419-4199-ad40-01d06122c257 req-12964da3-892a-4d49-8b5f-a475f5075c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdafcf28-8b2d-4692-ba35-cd63d2c32de7", "name": "network-vif-plugged", "status": "completed", "tag": "7beeb33e-b868-478b-961b-f1fcce969c8c"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:19.374780 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-48de3d59-6419-4199-ad40-01d06122c257 req-12964da3-892a-4d49-8b5f-a475f5075c90 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:19.376129 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-48de3d59-6419-4199-ad40-01d06122c257 req-12964da3-892a-4d49-8b5f-a475f5075c90 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.405066 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-48de3d59-6419-4199-ad40-01d06122c257 req-12964da3-892a-4d49-8b5f-a475f5075c90 service nova] Creating event network-vif-plugged:7beeb33e-b868-478b-961b-f1fcce969c8c for instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 on hv-cinder-85069 Jul 21 22:35:19.418185 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-48de3d59-6419-4199-ad40-01d06122c257 req-12964da3-892a-4d49-8b5f-a475f5075c90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078738 Jul 21 22:35:19.421489 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 133/264] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:19.697730 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-940b6fd2-b53d-47ff-a1ca-1e8fbc502f31 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:19.698869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-43354936-8628-45da-b79c-3e0bd7484dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:19.699402 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-940b6fd2-b53d-47ff-a1ca-1e8fbc502f31 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:19.700423 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-43354936-8628-45da-b79c-3e0bd7484dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:19.714570 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-940b6fd2-b53d-47ff-a1ca-1e8fbc502f31 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:19.716511 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-940b6fd2-b53d-47ff-a1ca-1e8fbc502f31 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.718639 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-940b6fd2-b53d-47ff-a1ca-1e8fbc502f31 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:19.719968 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-940b6fd2-b53d-47ff-a1ca-1e8fbc502f31 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.758276 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-43354936-8628-45da-b79c-3e0bd7484dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:19.760394 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-43354936-8628-45da-b79c-3e0bd7484dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.763262 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-43354936-8628-45da-b79c-3e0bd7484dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:19.765329 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-43354936-8628-45da-b79c-3e0bd7484dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.837255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=100 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:21.059903 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-43354936-8628-45da-b79c-3e0bd7484dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:21.094871 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-940b6fd2-b53d-47ff-a1ca-1e8fbc502f31 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:21.105612 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:21.113875 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-43354936-8628-45da-b79c-3e0bd7484dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1699 microversion: 2.1 time: 1.424493 Jul 21 22:35:21.117493 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 132/265] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:19 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1699 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:21.145468 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-936e2d3f-011c-43e5-a16c-2755f6b0c5cc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Action: 'create', calling method: .version_select at 0x7f47e6924790>, body: {"keypair": {"name": "tempest-keypair-102915505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3kK5WAQ+9EmaqVPtwYxzcSebb3uLE2l7MOATHkCfwy/TxSj3vMXCHEXXcvYEm4gAnAl1P8g8EJy1zmFalQ/TCBNVdCBN1P4LkcRsXTjCH/SSEVAucKfAhAbZ/DBHy+pw=="}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:21.149649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-940b6fd2-b53d-47ff-a1ca-1e8fbc502f31 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:21.167203 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-940b6fd2-b53d-47ff-a1ca-1e8fbc502f31 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:21.172394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-940b6fd2-b53d-47ff-a1ca-1e8fbc502f31 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1739 microversion: 2.20 time: 1.483630 Jul 21 22:35:21.177585 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 134/266] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:19 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1739 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:21.230126 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7f63ad7d-5781-4b48-bd63-086c58aea1aa tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:21.241032 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-936e2d3f-011c-43e5-a16c-2755f6b0c5cc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Getting quotas for project 3138cf3bb8a24ba19295565fca0a471e. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:35:21.272169 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-936e2d3f-011c-43e5-a16c-2755f6b0c5cc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Getting quotas for user cf3fd4428e3b46cd9e83e1d32571097b and project 3138cf3bb8a24ba19295565fca0a471e. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:35:21.276293 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7f63ad7d-5781-4b48-bd63-086c58aea1aa tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:21.281184 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7f63ad7d-5781-4b48-bd63-086c58aea1aa tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:21.378081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-936e2d3f-011c-43e5-a16c-2755f6b0c5cc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.256493 Jul 21 22:35:21.384356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 133/267] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 22:35:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:21.488227 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7f63ad7d-5781-4b48-bd63-086c58aea1aa tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Going to try to start instance {{(pid=124498) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 22:35:21.639579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7f63ad7d-5781-4b48-bd63-086c58aea1aa tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "POST /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/action" status: 202 len: 0 microversion: 2.1 time: 0.453140 Jul 21 22:35:21.642771 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 135/268] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:35:21 2022] POST /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:35:21.668435 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3c0bb2e7-b97f-4508-8601-a556e37a4113 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:21.675517 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3c0bb2e7-b97f-4508-8601-a556e37a4113 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:21.705950 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3c0bb2e7-b97f-4508-8601-a556e37a4113 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:21.708932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3c0bb2e7-b97f-4508-8601-a556e37a4113 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:21.711449 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3c0bb2e7-b97f-4508-8601-a556e37a4113 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:21.713190 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3c0bb2e7-b97f-4508-8601-a556e37a4113 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:22.206956 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3f2c13e4-1fb3-4ba2-b7f9-c373d0efe2ad tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:22.216575 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3f2c13e4-1fb3-4ba2-b7f9-c373d0efe2ad tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:22.243082 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3f2c13e4-1fb3-4ba2-b7f9-c373d0efe2ad tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:22.243897 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3f2c13e4-1fb3-4ba2-b7f9-c373d0efe2ad tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:22.244928 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3f2c13e4-1fb3-4ba2-b7f9-c373d0efe2ad tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:22.245870 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3f2c13e4-1fb3-4ba2-b7f9-c373d0efe2ad tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:22.789200 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3c0bb2e7-b97f-4508-8601-a556e37a4113 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:22.814264 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3c0bb2e7-b97f-4508-8601-a556e37a4113 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1708 microversion: 2.1 time: 1.150415 Jul 21 22:35:22.816392 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 134/269] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:21 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1708 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:23.086165 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3f2c13e4-1fb3-4ba2-b7f9-c373d0efe2ad tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:23.104655 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3f2c13e4-1fb3-4ba2-b7f9-c373d0efe2ad tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:23.108162 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3f2c13e4-1fb3-4ba2-b7f9-c373d0efe2ad tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:23.110400 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3f2c13e4-1fb3-4ba2-b7f9-c373d0efe2ad tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1739 microversion: 2.20 time: 0.917035 Jul 21 22:35:23.115767 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 136/270] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:22 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1739 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:23.839079 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-45d6b25d-56d1-48e6-a61f-14712c1c1cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:23.840061 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-45d6b25d-56d1-48e6-a61f-14712c1c1cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:23.865599 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-45d6b25d-56d1-48e6-a61f-14712c1c1cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:23.866388 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-45d6b25d-56d1-48e6-a61f-14712c1c1cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:23.867342 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-45d6b25d-56d1-48e6-a61f-14712c1c1cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:23.869516 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-45d6b25d-56d1-48e6-a61f-14712c1c1cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:24.147560 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-74f42334-d8f8-495b-bef6-21b1ed6f09e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:24.148673 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-74f42334-d8f8-495b-bef6-21b1ed6f09e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:24.167621 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-74f42334-d8f8-495b-bef6-21b1ed6f09e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:24.168473 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-74f42334-d8f8-495b-bef6-21b1ed6f09e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:24.173144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-74f42334-d8f8-495b-bef6-21b1ed6f09e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:24.174687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-74f42334-d8f8-495b-bef6-21b1ed6f09e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:24.598827 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-45d6b25d-56d1-48e6-a61f-14712c1c1cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:24.612237 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-45d6b25d-56d1-48e6-a61f-14712c1c1cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1708 microversion: 2.1 time: 0.782206 Jul 21 22:35:24.618124 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 135/271] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:23 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1708 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:24.790010 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-74f42334-d8f8-495b-bef6-21b1ed6f09e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:24.813423 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-74f42334-d8f8-495b-bef6-21b1ed6f09e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:24.815514 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-74f42334-d8f8-495b-bef6-21b1ed6f09e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:24.817103 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-74f42334-d8f8-495b-bef6-21b1ed6f09e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1739 microversion: 2.20 time: 0.687105 Jul 21 22:35:24.823175 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 137/272] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:24 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1739 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:25.578104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1542375543", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a9b553d-ef3b-4e67-b2f3-50140476634a"}], "security_groups": [{"name": "tempest-securitygroup--709979245"}], "key_name": "tempest-keypair-102915505", "user_data": "}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:25.668351 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b2d3a0c1-1b64-419c-a876-ea9ed88d7d9a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:25.669064 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b2d3a0c1-1b64-419c-a876-ea9ed88d7d9a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:25.681490 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b2d3a0c1-1b64-419c-a876-ea9ed88d7d9a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:25.681820 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b2d3a0c1-1b64-419c-a876-ea9ed88d7d9a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:25.721836 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b2d3a0c1-1b64-419c-a876-ea9ed88d7d9a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:25.722410 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b2d3a0c1-1b64-419c-a876-ea9ed88d7d9a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:26.133728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b2d3a0c1-1b64-419c-a876-ea9ed88d7d9a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:26.144933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b2d3a0c1-1b64-419c-a876-ea9ed88d7d9a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1708 microversion: 2.1 time: 0.488627 Jul 21 22:35:26.149193 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 138/273] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:25 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1708 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:26.157182 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f7017cf9-7a92-4a25-ad64-a172f0312a94 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:26.158142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f7017cf9-7a92-4a25-ad64-a172f0312a94 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:26.177755 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f7017cf9-7a92-4a25-ad64-a172f0312a94 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:26.178314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f7017cf9-7a92-4a25-ad64-a172f0312a94 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:26.179079 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f7017cf9-7a92-4a25-ad64-a172f0312a94 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:26.181376 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f7017cf9-7a92-4a25-ad64-a172f0312a94 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:26.642890 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f7017cf9-7a92-4a25-ad64-a172f0312a94 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:26.660638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f7017cf9-7a92-4a25-ad64-a172f0312a94 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:26.665281 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f7017cf9-7a92-4a25-ad64-a172f0312a94 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:26.668932 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f7017cf9-7a92-4a25-ad64-a172f0312a94 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1739 microversion: 2.20 time: 0.518116 Jul 21 22:35:26.670642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 139/274] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:26 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1739 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:27.171785 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-50ac2199-9b38-4a72-b9dd-b3350485d3f3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:27.172953 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-50ac2199-9b38-4a72-b9dd-b3350485d3f3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:27.196656 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50ac2199-9b38-4a72-b9dd-b3350485d3f3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:27.197081 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50ac2199-9b38-4a72-b9dd-b3350485d3f3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:27.198133 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50ac2199-9b38-4a72-b9dd-b3350485d3f3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:27.198576 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50ac2199-9b38-4a72-b9dd-b3350485d3f3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:27.498207 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-50ac2199-9b38-4a72-b9dd-b3350485d3f3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:27.514237 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-50ac2199-9b38-4a72-b9dd-b3350485d3f3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1712 microversion: 2.1 time: 0.351206 Jul 21 22:35:27.518430 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 140/275] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:27 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1712 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:27.692627 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8c08f110-b034-4304-846e-0658f6714348 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:27.711753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8c08f110-b034-4304-846e-0658f6714348 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:27.735093 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8c08f110-b034-4304-846e-0658f6714348 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:27.738013 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8c08f110-b034-4304-846e-0658f6714348 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:27.749572 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8c08f110-b034-4304-846e-0658f6714348 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:27.751719 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8c08f110-b034-4304-846e-0658f6714348 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:28.070771 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8c08f110-b034-4304-846e-0658f6714348 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:28.085510 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8c08f110-b034-4304-846e-0658f6714348 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:28.087411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8c08f110-b034-4304-846e-0658f6714348 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:28.088805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8c08f110-b034-4304-846e-0658f6714348 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1739 microversion: 2.20 time: 0.400479 Jul 21 22:35:28.107117 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 141/276] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:27 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1739 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:29.119633 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e467c385-48e2-4402-8098-7e808c68fbbb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:29.120723 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e467c385-48e2-4402-8098-7e808c68fbbb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:29.127424 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e467c385-48e2-4402-8098-7e808c68fbbb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:29.128209 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e467c385-48e2-4402-8098-7e808c68fbbb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:29.129182 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e467c385-48e2-4402-8098-7e808c68fbbb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:29.129790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e467c385-48e2-4402-8098-7e808c68fbbb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:29.477188 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e467c385-48e2-4402-8098-7e808c68fbbb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:29.491163 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e467c385-48e2-4402-8098-7e808c68fbbb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:29.494592 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e467c385-48e2-4402-8098-7e808c68fbbb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:29.496136 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e467c385-48e2-4402-8098-7e808c68fbbb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1739 microversion: 2.20 time: 0.382912 Jul 21 22:35:29.496892 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 142/277] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:29 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1739 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:30.535004 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-460acc2f-a446-46b4-bddc-3de40abe0b05 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:30.542523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-460acc2f-a446-46b4-bddc-3de40abe0b05 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:30.580854 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-460acc2f-a446-46b4-bddc-3de40abe0b05 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:30.582157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-460acc2f-a446-46b4-bddc-3de40abe0b05 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:30.588608 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-460acc2f-a446-46b4-bddc-3de40abe0b05 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:30.588608 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-460acc2f-a446-46b4-bddc-3de40abe0b05 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:31.041728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-460acc2f-a446-46b4-bddc-3de40abe0b05 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:31.058761 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-460acc2f-a446-46b4-bddc-3de40abe0b05 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:31.060878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-460acc2f-a446-46b4-bddc-3de40abe0b05 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:31.065052 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-460acc2f-a446-46b4-bddc-3de40abe0b05 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1739 microversion: 2.20 time: 0.535588 Jul 21 22:35:31.066450 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 143/278] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:30 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1739 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:31.314486 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=4 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:32.096237 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b0dd184e-d1c1-4e62-9da6-a588eb9ef97a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:32.097366 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b0dd184e-d1c1-4e62-9da6-a588eb9ef97a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:32.128146 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b0dd184e-d1c1-4e62-9da6-a588eb9ef97a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:32.128449 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b0dd184e-d1c1-4e62-9da6-a588eb9ef97a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:32.129360 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b0dd184e-d1c1-4e62-9da6-a588eb9ef97a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:32.129958 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b0dd184e-d1c1-4e62-9da6-a588eb9ef97a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:32.415465 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b0dd184e-d1c1-4e62-9da6-a588eb9ef97a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:32.426818 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b0dd184e-d1c1-4e62-9da6-a588eb9ef97a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:32.430227 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b0dd184e-d1c1-4e62-9da6-a588eb9ef97a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:32.431522 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b0dd184e-d1c1-4e62-9da6-a588eb9ef97a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1739 microversion: 2.20 time: 0.344877 Jul 21 22:35:32.432375 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 144/279] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:32 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:33.159270 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-be482770-9aa4-4763-a486-1b4ac2edad7c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Action: 'create', calling method: .version_select at 0x7f47e6a369d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1156859559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZoMhaN++uPOSp1e2s1aYJNrthyb+BU7wJbO47RwJniP56MPRpkgIf1WXOhmzjVmHsZq4zI6b5zZeAwJRUZr3c7m6kBEUXeEqOm9WLf0sxdmEDoC7/dlOnOqztDyN/+7A=="}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:33.202609 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-be482770-9aa4-4763-a486-1b4ac2edad7c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Getting quotas for project 7a302ecda6ca4e778fadc4d9dcbef1e2. Resources: {'key_pairs'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:35:33.232451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-be482770-9aa4-4763-a486-1b4ac2edad7c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Getting quotas for user 13dbb228e1c846f48d37b43be84045f9 and project 7a302ecda6ca4e778fadc4d9dcbef1e2. Resources: {'key_pairs'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:35:33.285052 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-be482770-9aa4-4763-a486-1b4ac2edad7c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.127409 Jul 21 22:35:33.295823 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] validate_networks() for [('5a9b553d-ef3b-4e67-b2f3-50140476634a', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:35:33.312311 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 145/280] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 22:35:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:35:33.463847 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d371c0aa-ad6f-47e9-a160-14ac0fdeff8d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:33.464648 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d371c0aa-ad6f-47e9-a160-14ac0fdeff8d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:33.479913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d371c0aa-ad6f-47e9-a160-14ac0fdeff8d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:33.481180 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d371c0aa-ad6f-47e9-a160-14ac0fdeff8d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:33.482246 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d371c0aa-ad6f-47e9-a160-14ac0fdeff8d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:33.484419 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d371c0aa-ad6f-47e9-a160-14ac0fdeff8d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:33.716432 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:33.857195 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d371c0aa-ad6f-47e9-a160-14ac0fdeff8d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:33.876012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d371c0aa-ad6f-47e9-a160-14ac0fdeff8d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:33.878681 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d371c0aa-ad6f-47e9-a160-14ac0fdeff8d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:33.878681 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d371c0aa-ad6f-47e9-a160-14ac0fdeff8d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1739 microversion: 2.20 time: 0.426308 Jul 21 22:35:33.890680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 146/281] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:33 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1739 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:33.896205 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-509329127", "imageRef": "b486b6d3-7827-4c6c-b31e-0518dad667a1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1156859559", "networks": [{"uuid": "52ae863f-552a-4026-810d-cd8864f550df"}]}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:33.904172 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:33.971345 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.network.neutron [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] validate_networks() for [('52ae863f-552a-4026-810d-cd8864f550df', None, None, None, None, None)] {{(pid=124498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:35:34.126231 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:35:34.126925 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:35:34.127880 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:35:34.128429 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:35:34.129003 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:35:34.143811 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:34.144625 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:34.145570 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:34.146602 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:34.188126 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Getting quotas for project 3138cf3bb8a24ba19295565fca0a471e. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:35:34.201535 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Getting quotas for user cf3fd4428e3b46cd9e83e1d32571097b and project 3138cf3bb8a24ba19295565fca0a471e. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:35:34.229156 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:35:34.231607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:35:34.303146 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-19f5d9fd-76b8-4c39-9791-6fe79e31f9be tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 8.728802 Jul 21 22:35:34.309870 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 136/282] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:35:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 8737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:35:34.325848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-29c79405-3d0a-45b9-a1d7-813a606f5219 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:34.325848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-29c79405-3d0a-45b9-a1d7-813a606f5219 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:34.459918 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-29c79405-3d0a-45b9-a1d7-813a606f5219 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:34.470727 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-29c79405-3d0a-45b9-a1d7-813a606f5219 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1245 microversion: 2.1 time: 0.159491 Jul 21 22:35:34.471795 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 137/283] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:34 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1245 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:34.753003 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Flavor limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:35:34.753644 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Image limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:35:34.755512 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Flavor pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:35:34.756354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Image pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:35:34.757170 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:35:34.787325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:34.788211 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:34.789930 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:34.790800 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:34.825328 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Getting quotas for project 7a302ecda6ca4e778fadc4d9dcbef1e2. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:35:34.834756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Getting quotas for user 13dbb228e1c846f48d37b43be84045f9 and project 7a302ecda6ca4e778fadc4d9dcbef1e2. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:35:34.851158 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Going to run 1 instances... {{(pid=124498) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:35:34.853809 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b486b6d3-7827-4c6c-b31e-0518dad667a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:35:34.907995 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-922b163f-9481-40b2-baa0-1ae85e8b8659 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:34.909459 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-922b163f-9481-40b2-baa0-1ae85e8b8659 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:34.925225 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-922b163f-9481-40b2-baa0-1ae85e8b8659 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:34.926335 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-922b163f-9481-40b2-baa0-1ae85e8b8659 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:34.929884 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-922b163f-9481-40b2-baa0-1ae85e8b8659 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:34.930682 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-922b163f-9481-40b2-baa0-1ae85e8b8659 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:34.944182 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0cae7074-dc39-49c1-bce6-751191d6a150 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050816 Jul 21 22:35:34.952877 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 147/284] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:35:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:35:34.964557 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8471cd71-7a27-464e-86ea-49e6b76ebc67 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:34.965576 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8471cd71-7a27-464e-86ea-49e6b76ebc67 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:35.190043 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8471cd71-7a27-464e-86ea-49e6b76ebc67 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:35.216825 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8471cd71-7a27-464e-86ea-49e6b76ebc67 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1258 microversion: 2.1 time: 0.261381 Jul 21 22:35:35.217865 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 148/285] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:34 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1258 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:35.325855 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-922b163f-9481-40b2-baa0-1ae85e8b8659 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:35.340182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-922b163f-9481-40b2-baa0-1ae85e8b8659 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:35.342707 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-922b163f-9481-40b2-baa0-1ae85e8b8659 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:35.344699 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-922b163f-9481-40b2-baa0-1ae85e8b8659 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1739 microversion: 2.20 time: 0.444689 Jul 21 22:35:35.345892 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 138/286] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:34 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1739 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:35.490815 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4ba40645-b23d-4806-b1b3-d66b560653f4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:35.491884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4ba40645-b23d-4806-b1b3-d66b560653f4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:35.498933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ba40645-b23d-4806-b1b3-d66b560653f4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:35.499894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ba40645-b23d-4806-b1b3-d66b560653f4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:35.500963 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ba40645-b23d-4806-b1b3-d66b560653f4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:35.501648 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ba40645-b23d-4806-b1b3-d66b560653f4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:35.578644 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4ba40645-b23d-4806-b1b3-d66b560653f4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:35.587695 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4ba40645-b23d-4806-b1b3-d66b560653f4 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1297 microversion: 2.1 time: 0.101942 Jul 21 22:35:35.588395 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 149/287] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:35 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:36.243815 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-77a983c0-2e88-46f0-8a1a-bb05a9f7b87f tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:36.244451 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-77a983c0-2e88-46f0-8a1a-bb05a9f7b87f tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:36.252049 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-77a983c0-2e88-46f0-8a1a-bb05a9f7b87f tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:36.252873 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-77a983c0-2e88-46f0-8a1a-bb05a9f7b87f tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:36.253924 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-77a983c0-2e88-46f0-8a1a-bb05a9f7b87f tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:36.254620 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-77a983c0-2e88-46f0-8a1a-bb05a9f7b87f tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:36.337514 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-77a983c0-2e88-46f0-8a1a-bb05a9f7b87f tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:36.346997 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-77a983c0-2e88-46f0-8a1a-bb05a9f7b87f tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1310 microversion: 2.1 time: 0.108692 Jul 21 22:35:36.348243 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 139/288] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:36 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1310 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:36.370353 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c1c08fe0-0d08-42c2-95e8-8e9e34249a11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:36.370897 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c1c08fe0-0d08-42c2-95e8-8e9e34249a11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:36.377519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c1c08fe0-0d08-42c2-95e8-8e9e34249a11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:36.377962 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c1c08fe0-0d08-42c2-95e8-8e9e34249a11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:36.378814 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c1c08fe0-0d08-42c2-95e8-8e9e34249a11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:36.379403 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c1c08fe0-0d08-42c2-95e8-8e9e34249a11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:36.619698 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f062c710-5f52-464a-ae25-2028fbccaf82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:36.620881 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f062c710-5f52-464a-ae25-2028fbccaf82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:36.630052 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f062c710-5f52-464a-ae25-2028fbccaf82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:36.631194 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c1c08fe0-0d08-42c2-95e8-8e9e34249a11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:36.631515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f062c710-5f52-464a-ae25-2028fbccaf82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:36.632306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f062c710-5f52-464a-ae25-2028fbccaf82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:36.632749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f062c710-5f52-464a-ae25-2028fbccaf82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:36.651383 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c1c08fe0-0d08-42c2-95e8-8e9e34249a11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:36.663507 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c1c08fe0-0d08-42c2-95e8-8e9e34249a11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:36.665669 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c1c08fe0-0d08-42c2-95e8-8e9e34249a11 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1721 microversion: 2.20 time: 0.299465 Jul 21 22:35:36.672290 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 150/289] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:36 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:36.760145 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f062c710-5f52-464a-ae25-2028fbccaf82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:36.768820 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f062c710-5f52-464a-ae25-2028fbccaf82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1303 microversion: 2.1 time: 0.156030 Jul 21 22:35:36.770429 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 140/290] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:36 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1303 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:37.370715 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c30ec763-4d2d-4382-83b5-1aa9a292d356 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:37.371456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c30ec763-4d2d-4382-83b5-1aa9a292d356 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:37.383504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c30ec763-4d2d-4382-83b5-1aa9a292d356 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:37.383956 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c30ec763-4d2d-4382-83b5-1aa9a292d356 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:37.384740 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c30ec763-4d2d-4382-83b5-1aa9a292d356 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:37.385180 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c30ec763-4d2d-4382-83b5-1aa9a292d356 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:37.478214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c30ec763-4d2d-4382-83b5-1aa9a292d356 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:37.490665 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c30ec763-4d2d-4382-83b5-1aa9a292d356 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1316 microversion: 2.1 time: 0.128890 Jul 21 22:35:37.501945 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 151/291] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:37 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1316 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:37.690285 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-52cbdf8b-7a1c-4810-bb6a-2186682bf79d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:37.691722 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-52cbdf8b-7a1c-4810-bb6a-2186682bf79d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:37.700142 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-52cbdf8b-7a1c-4810-bb6a-2186682bf79d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:37.703263 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-52cbdf8b-7a1c-4810-bb6a-2186682bf79d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:37.704301 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-52cbdf8b-7a1c-4810-bb6a-2186682bf79d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:37.704904 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-52cbdf8b-7a1c-4810-bb6a-2186682bf79d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:37.793068 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7ad335f6-e682-44d1-9a79-6a4bd7826cf1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:37.795234 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7ad335f6-e682-44d1-9a79-6a4bd7826cf1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:37.809401 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ad335f6-e682-44d1-9a79-6a4bd7826cf1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:37.810328 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ad335f6-e682-44d1-9a79-6a4bd7826cf1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:37.812166 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ad335f6-e682-44d1-9a79-6a4bd7826cf1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:37.812930 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7ad335f6-e682-44d1-9a79-6a4bd7826cf1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:38.269749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-52cbdf8b-7a1c-4810-bb6a-2186682bf79d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:38.285173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-52cbdf8b-7a1c-4810-bb6a-2186682bf79d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:38.287538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-52cbdf8b-7a1c-4810-bb6a-2186682bf79d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:38.289583 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-52cbdf8b-7a1c-4810-bb6a-2186682bf79d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1721 microversion: 2.20 time: 0.603789 Jul 21 22:35:38.290707 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 141/292] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:37 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1721 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:38.300340 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-cb2966fd-2344-4898-a4e8-4ec49dfd41ba req-d270caa3-57e1-44ab-8f05-09e855832f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c214c984-d0d9-4920-882c-6b481647edc5", "tag": "2474b6a6-f120-434b-bba6-8abb5364b833"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:38.315504 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-cb2966fd-2344-4898-a4e8-4ec49dfd41ba req-d270caa3-57e1-44ab-8f05-09e855832f0c service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:38.316535 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-cb2966fd-2344-4898-a4e8-4ec49dfd41ba req-d270caa3-57e1-44ab-8f05-09e855832f0c service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:38.327043 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7ad335f6-e682-44d1-9a79-6a4bd7826cf1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:38.334752 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-cb2966fd-2344-4898-a4e8-4ec49dfd41ba req-d270caa3-57e1-44ab-8f05-09e855832f0c service nova] Creating event network-changed:2474b6a6-f120-434b-bba6-8abb5364b833 for instance c214c984-d0d9-4920-882c-6b481647edc5 on hv-cinder-85069 Jul 21 22:35:38.337378 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7ad335f6-e682-44d1-9a79-6a4bd7826cf1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.552379 Jul 21 22:35:38.340340 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-cb2966fd-2344-4898-a4e8-4ec49dfd41ba req-d270caa3-57e1-44ab-8f05-09e855832f0c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047476 Jul 21 22:35:38.340942 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 142/293] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:38.346069 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 152/294] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:37 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:38.372956 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-ce5f8be0-5f15-4bda-8a41-745044b206e2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:38.373683 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-ce5f8be0-5f15-4bda-8a41-745044b206e2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:38.382424 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ce5f8be0-5f15-4bda-8a41-745044b206e2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:38.382996 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ce5f8be0-5f15-4bda-8a41-745044b206e2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:38.383813 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ce5f8be0-5f15-4bda-8a41-745044b206e2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:38.384248 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ce5f8be0-5f15-4bda-8a41-745044b206e2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:38.410635 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-ce5f8be0-5f15-4bda-8a41-745044b206e2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/ips" status: 200 len: 149 microversion: 2.1 time: 0.043829 Jul 21 22:35:38.411316 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 143/295] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 22:35:38 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:38.519698 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-59f4686d-af78-4825-84e7-062404591a71 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:38.521177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-59f4686d-af78-4825-84e7-062404591a71 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:38.528121 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-59f4686d-af78-4825-84e7-062404591a71 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:38.528651 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-59f4686d-af78-4825-84e7-062404591a71 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:38.529489 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-59f4686d-af78-4825-84e7-062404591a71 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:38.529985 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-59f4686d-af78-4825-84e7-062404591a71 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:38.533129 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:38.704743 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-59f4686d-af78-4825-84e7-062404591a71 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:38.713571 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-59f4686d-af78-4825-84e7-062404591a71 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.198024 Jul 21 22:35:38.714153 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 153/296] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:38 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:39.309893 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-06c7e255-ce6b-4fa4-b6ba-74ecc338a02a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:39.310737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-06c7e255-ce6b-4fa4-b6ba-74ecc338a02a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:39.319636 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06c7e255-ce6b-4fa4-b6ba-74ecc338a02a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.320133 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06c7e255-ce6b-4fa4-b6ba-74ecc338a02a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.320919 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06c7e255-ce6b-4fa4-b6ba-74ecc338a02a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.321359 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06c7e255-ce6b-4fa4-b6ba-74ecc338a02a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.357932 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-caff64ef-f532-4353-a241-52d0c426e3e3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:39.358551 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-caff64ef-f532-4353-a241-52d0c426e3e3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:39.371652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-caff64ef-f532-4353-a241-52d0c426e3e3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.372277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-caff64ef-f532-4353-a241-52d0c426e3e3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.372903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-caff64ef-f532-4353-a241-52d0c426e3e3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.373351 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-caff64ef-f532-4353-a241-52d0c426e3e3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.712821 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-06c7e255-ce6b-4fa4-b6ba-74ecc338a02a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:39.719607 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-caff64ef-f532-4353-a241-52d0c426e3e3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:39.727442 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-06c7e255-ce6b-4fa4-b6ba-74ecc338a02a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:39.730560 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-06c7e255-ce6b-4fa4-b6ba-74ecc338a02a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:39.732835 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-06c7e255-ce6b-4fa4-b6ba-74ecc338a02a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1721 microversion: 2.20 time: 0.426946 Jul 21 22:35:39.733882 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 144/297] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:39 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1721 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:39.741388 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-eb6522ce-2d81-435e-bdbb-5124c50312ac req-49b7ad48-f7e4-4321-9464-5fcb931080f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdafcf28-8b2d-4692-ba35-cd63d2c32de7", "name": "network-vif-unplugged", "status": "completed", "tag": "7beeb33e-b868-478b-961b-f1fcce969c8c"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:39.742602 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-caff64ef-f532-4353-a241-52d0c426e3e3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.388609 Jul 21 22:35:39.745023 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 154/298] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:39 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:39.748660 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a55683b7-90c0-4247-b14b-e43eb5b78ad8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:39.749283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a55683b7-90c0-4247-b14b-e43eb5b78ad8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:39.752832 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-eb6522ce-2d81-435e-bdbb-5124c50312ac req-49b7ad48-f7e4-4321-9464-5fcb931080f8 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.753498 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-eb6522ce-2d81-435e-bdbb-5124c50312ac req-49b7ad48-f7e4-4321-9464-5fcb931080f8 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.760146 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a55683b7-90c0-4247-b14b-e43eb5b78ad8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.760522 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a55683b7-90c0-4247-b14b-e43eb5b78ad8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.761702 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a55683b7-90c0-4247-b14b-e43eb5b78ad8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.762375 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a55683b7-90c0-4247-b14b-e43eb5b78ad8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.773226 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-eb6522ce-2d81-435e-bdbb-5124c50312ac req-49b7ad48-f7e4-4321-9464-5fcb931080f8 service nova] Creating event network-vif-unplugged:7beeb33e-b868-478b-961b-f1fcce969c8c for instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 on hv-cinder-85069 Jul 21 22:35:39.778977 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-eb6522ce-2d81-435e-bdbb-5124c50312ac req-49b7ad48-f7e4-4321-9464-5fcb931080f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043265 Jul 21 22:35:39.780049 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 145/299] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:39.863935 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-05efe0f1-12df-4443-aab2-50214e686043 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "684e15e4-6eb1-44a6-aab1-2484b62fa473"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:39.866006 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-05efe0f1-12df-4443-aab2-50214e686043 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:39.873357 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05efe0f1-12df-4443-aab2-50214e686043 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.874103 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05efe0f1-12df-4443-aab2-50214e686043 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.875090 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05efe0f1-12df-4443-aab2-50214e686043 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.875722 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05efe0f1-12df-4443-aab2-50214e686043 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:40.000922 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a55683b7-90c0-4247-b14b-e43eb5b78ad8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:40.017982 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a55683b7-90c0-4247-b14b-e43eb5b78ad8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.272890 Jul 21 22:35:40.019077 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 155/300] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:39 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:40.752276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5695701e-037e-4442-9273-bb0a272fa4c4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:40.753228 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-5695701e-037e-4442-9273-bb0a272fa4c4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:40.762677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5695701e-037e-4442-9273-bb0a272fa4c4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:40.763183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5695701e-037e-4442-9273-bb0a272fa4c4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:40.764006 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5695701e-037e-4442-9273-bb0a272fa4c4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:40.764687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5695701e-037e-4442-9273-bb0a272fa4c4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:40.928579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5695701e-037e-4442-9273-bb0a272fa4c4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:40.937127 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5695701e-037e-4442-9273-bb0a272fa4c4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:40.938648 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5695701e-037e-4442-9273-bb0a272fa4c4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:40.940080 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5695701e-037e-4442-9273-bb0a272fa4c4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1721 microversion: 2.20 time: 0.191855 Jul 21 22:35:40.940667 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 156/301] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:40 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:40.946066 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ee755acd-d17e-4123-86a3-2536b17894b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:40.946673 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ee755acd-d17e-4123-86a3-2536b17894b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:40.953039 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee755acd-d17e-4123-86a3-2536b17894b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:40.953490 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee755acd-d17e-4123-86a3-2536b17894b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:40.954282 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee755acd-d17e-4123-86a3-2536b17894b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:40.954724 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee755acd-d17e-4123-86a3-2536b17894b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:41.134200 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ee755acd-d17e-4123-86a3-2536b17894b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:41.151903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ee755acd-d17e-4123-86a3-2536b17894b1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.209652 Jul 21 22:35:41.165763 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 157/302] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:40 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:41.166738 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0e872530-02b7-4100-8565-692b83beceac tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:41.170576 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0e872530-02b7-4100-8565-692b83beceac tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:41.178159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0e872530-02b7-4100-8565-692b83beceac tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:41.178713 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0e872530-02b7-4100-8565-692b83beceac tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:41.179665 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0e872530-02b7-4100-8565-692b83beceac tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:41.180418 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0e872530-02b7-4100-8565-692b83beceac tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:41.414349 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-0e872530-02b7-4100-8565-692b83beceac tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:41.422450 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0e872530-02b7-4100-8565-692b83beceac tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.262378 Jul 21 22:35:41.423038 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 158/303] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:41 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:41.966414 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cc2d9fe2-edf3-4312-b7b8-7a30c1bfec79 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:41.967600 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-cc2d9fe2-edf3-4312-b7b8-7a30c1bfec79 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:41.974453 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc2d9fe2-edf3-4312-b7b8-7a30c1bfec79 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:41.974989 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc2d9fe2-edf3-4312-b7b8-7a30c1bfec79 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:41.975752 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc2d9fe2-edf3-4312-b7b8-7a30c1bfec79 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:41.976192 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc2d9fe2-edf3-4312-b7b8-7a30c1bfec79 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:42.163814 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cc2d9fe2-edf3-4312-b7b8-7a30c1bfec79 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:42.176108 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cc2d9fe2-edf3-4312-b7b8-7a30c1bfec79 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:42.176938 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cc2d9fe2-edf3-4312-b7b8-7a30c1bfec79 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:42.179604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-cc2d9fe2-edf3-4312-b7b8-7a30c1bfec79 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1721 microversion: 2.20 time: 0.217770 Jul 21 22:35:42.180538 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 159/304] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:41 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:42.187890 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-41df2e9c-86c2-4bf1-aecf-787144784b25 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:42.189101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-41df2e9c-86c2-4bf1-aecf-787144784b25 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:42.202812 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-41df2e9c-86c2-4bf1-aecf-787144784b25 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:42.203717 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-41df2e9c-86c2-4bf1-aecf-787144784b25 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:42.205028 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-41df2e9c-86c2-4bf1-aecf-787144784b25 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:42.205549 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-41df2e9c-86c2-4bf1-aecf-787144784b25 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:42.428546 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-41df2e9c-86c2-4bf1-aecf-787144784b25 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:42.448554 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-41df2e9c-86c2-4bf1-aecf-787144784b25 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.264914 Jul 21 22:35:42.449800 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 160/305] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:42 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:42.463446 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b8f7539c-0f14-4caa-b2ba-8ccc8486badf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:42.463446 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b8f7539c-0f14-4caa-b2ba-8ccc8486badf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:42.471817 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b8f7539c-0f14-4caa-b2ba-8ccc8486badf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:42.473297 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b8f7539c-0f14-4caa-b2ba-8ccc8486badf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:42.475046 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b8f7539c-0f14-4caa-b2ba-8ccc8486badf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:42.475651 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b8f7539c-0f14-4caa-b2ba-8ccc8486badf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:42.718759 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b8f7539c-0f14-4caa-b2ba-8ccc8486badf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:42.735221 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b8f7539c-0f14-4caa-b2ba-8ccc8486badf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.283115 Jul 21 22:35:42.736541 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 161/306] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:42 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:43.204262 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-36702d5a-fbc1-475e-857f-91fe107a3b86 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:43.205014 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-36702d5a-fbc1-475e-857f-91fe107a3b86 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:43.212066 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-36702d5a-fbc1-475e-857f-91fe107a3b86 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.212428 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-36702d5a-fbc1-475e-857f-91fe107a3b86 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.213210 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-36702d5a-fbc1-475e-857f-91fe107a3b86 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.213646 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-36702d5a-fbc1-475e-857f-91fe107a3b86 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.433842 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-36702d5a-fbc1-475e-857f-91fe107a3b86 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:43.444419 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-36702d5a-fbc1-475e-857f-91fe107a3b86 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:43.446417 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-36702d5a-fbc1-475e-857f-91fe107a3b86 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:43.448034 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-36702d5a-fbc1-475e-857f-91fe107a3b86 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1721 microversion: 2.20 time: 0.249693 Jul 21 22:35:43.451489 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 162/307] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:43 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:43.473801 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-21051699-54af-4afd-8813-40c6d5313880 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:43.474434 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-21051699-54af-4afd-8813-40c6d5313880 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:43.482294 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-21051699-54af-4afd-8813-40c6d5313880 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.483120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-21051699-54af-4afd-8813-40c6d5313880 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.484004 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-21051699-54af-4afd-8813-40c6d5313880 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.484444 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-21051699-54af-4afd-8813-40c6d5313880 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.671716 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-21051699-54af-4afd-8813-40c6d5313880 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:43.680505 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-21051699-54af-4afd-8813-40c6d5313880 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.210516 Jul 21 22:35:43.681392 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 163/308] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:43 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:43.762857 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-511fd491-b7d3-4134-b152-72146b53ff1a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:43.764066 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-511fd491-b7d3-4134-b152-72146b53ff1a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:43.772790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-511fd491-b7d3-4134-b152-72146b53ff1a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.773234 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-511fd491-b7d3-4134-b152-72146b53ff1a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.774035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-511fd491-b7d3-4134-b152-72146b53ff1a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.774467 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-511fd491-b7d3-4134-b152-72146b53ff1a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.969416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-511fd491-b7d3-4134-b152-72146b53ff1a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:43.978642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-511fd491-b7d3-4134-b152-72146b53ff1a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.223319 Jul 21 22:35:43.979472 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 164/309] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:43 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:44.164140 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:44.470025 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=8 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:44.472286 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-dc1c11da-aeab-4600-8ff0-d6b15a45e860 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:44.473660 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-dc1c11da-aeab-4600-8ff0-d6b15a45e860 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:44.484484 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dc1c11da-aeab-4600-8ff0-d6b15a45e860 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:44.485290 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dc1c11da-aeab-4600-8ff0-d6b15a45e860 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:44.486513 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dc1c11da-aeab-4600-8ff0-d6b15a45e860 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:44.487303 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-dc1c11da-aeab-4600-8ff0-d6b15a45e860 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:44.721972 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-dc1c11da-aeab-4600-8ff0-d6b15a45e860 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:44.731648 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-dc1c11da-aeab-4600-8ff0-d6b15a45e860 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:44.733230 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-dc1c11da-aeab-4600-8ff0-d6b15a45e860 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:44.734483 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-dc1c11da-aeab-4600-8ff0-d6b15a45e860 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1721 microversion: 2.20 time: 0.269670 Jul 21 22:35:44.747362 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 165/310] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:44 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:44.752391 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5cfae0fe-4a3f-42ac-82e1-cf5d9912d3dd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:44.753018 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-5cfae0fe-4a3f-42ac-82e1-cf5d9912d3dd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:44.760183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5cfae0fe-4a3f-42ac-82e1-cf5d9912d3dd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:44.760633 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5cfae0fe-4a3f-42ac-82e1-cf5d9912d3dd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:44.761547 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5cfae0fe-4a3f-42ac-82e1-cf5d9912d3dd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:44.761988 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5cfae0fe-4a3f-42ac-82e1-cf5d9912d3dd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:44.814982 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:44.966550 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5cfae0fe-4a3f-42ac-82e1-cf5d9912d3dd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:44.976745 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5cfae0fe-4a3f-42ac-82e1-cf5d9912d3dd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.228109 Jul 21 22:35:44.977825 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 166/311] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:44 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:44.996735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-98678ff2-ac5b-445c-9bbd-aa3f7c70e0ec tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:44.997721 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-98678ff2-ac5b-445c-9bbd-aa3f7c70e0ec tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:45.005838 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98678ff2-ac5b-445c-9bbd-aa3f7c70e0ec tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:45.006464 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98678ff2-ac5b-445c-9bbd-aa3f7c70e0ec tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:45.007646 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98678ff2-ac5b-445c-9bbd-aa3f7c70e0ec tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:45.008182 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98678ff2-ac5b-445c-9bbd-aa3f7c70e0ec tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:45.216176 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=12 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:45.282647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-98678ff2-ac5b-445c-9bbd-aa3f7c70e0ec tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:45.294020 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-98678ff2-ac5b-445c-9bbd-aa3f7c70e0ec tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.301158 Jul 21 22:35:45.294821 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 167/312] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:44 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:45.764411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-24eee1b0-6cfb-4960-a60a-530d5b085d22 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:45.765218 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-24eee1b0-6cfb-4960-a60a-530d5b085d22 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:45.772744 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-24eee1b0-6cfb-4960-a60a-530d5b085d22 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:45.773200 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-24eee1b0-6cfb-4960-a60a-530d5b085d22 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:45.774113 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-24eee1b0-6cfb-4960-a60a-530d5b085d22 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:45.774560 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-24eee1b0-6cfb-4960-a60a-530d5b085d22 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:45.968741 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-24eee1b0-6cfb-4960-a60a-530d5b085d22 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:45.981268 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-24eee1b0-6cfb-4960-a60a-530d5b085d22 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:45.983330 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-24eee1b0-6cfb-4960-a60a-530d5b085d22 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:45.984754 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-24eee1b0-6cfb-4960-a60a-530d5b085d22 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1721 microversion: 2.20 time: 0.224658 Jul 21 22:35:45.985330 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 168/313] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:45 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:45.995569 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-42059d68-1701-47b4-ab94-3201b1fb4227 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:45.996335 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-42059d68-1701-47b4-ab94-3201b1fb4227 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:46.006336 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-42059d68-1701-47b4-ab94-3201b1fb4227 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:46.006938 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-42059d68-1701-47b4-ab94-3201b1fb4227 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:46.008179 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-42059d68-1701-47b4-ab94-3201b1fb4227 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:46.008842 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-42059d68-1701-47b4-ab94-3201b1fb4227 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:46.200699 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-42059d68-1701-47b4-ab94-3201b1fb4227 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:46.203021 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=100 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:46.210909 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-42059d68-1701-47b4-ab94-3201b1fb4227 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.220264 Jul 21 22:35:46.211852 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 169/314] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:45 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:46.320242 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-25f769b0-08af-4d62-a2d5-b16204f7ccf4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:46.321598 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-25f769b0-08af-4d62-a2d5-b16204f7ccf4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:46.334920 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-25f769b0-08af-4d62-a2d5-b16204f7ccf4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:46.335860 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-25f769b0-08af-4d62-a2d5-b16204f7ccf4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:46.337539 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-25f769b0-08af-4d62-a2d5-b16204f7ccf4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:46.338241 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-25f769b0-08af-4d62-a2d5-b16204f7ccf4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:46.574216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-25f769b0-08af-4d62-a2d5-b16204f7ccf4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:46.591945 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-25f769b0-08af-4d62-a2d5-b16204f7ccf4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.281899 Jul 21 22:35:46.593166 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 170/315] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:46 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:47.006274 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f6b78efa-7541-45bd-b53e-b8e329dc2423 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:47.007029 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f6b78efa-7541-45bd-b53e-b8e329dc2423 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:47.013624 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6b78efa-7541-45bd-b53e-b8e329dc2423 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.014608 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6b78efa-7541-45bd-b53e-b8e329dc2423 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.014879 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6b78efa-7541-45bd-b53e-b8e329dc2423 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.015353 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f6b78efa-7541-45bd-b53e-b8e329dc2423 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.207524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f6b78efa-7541-45bd-b53e-b8e329dc2423 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:47.227537 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f6b78efa-7541-45bd-b53e-b8e329dc2423 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:47.229415 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f6b78efa-7541-45bd-b53e-b8e329dc2423 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:47.230658 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f6b78efa-7541-45bd-b53e-b8e329dc2423 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1721 microversion: 2.20 time: 0.229828 Jul 21 22:35:47.231353 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 171/316] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:46 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:47.247094 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7db5348d-2f3b-4302-8ccb-dc0327b47dc0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:47.247726 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7db5348d-2f3b-4302-8ccb-dc0327b47dc0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:47.256610 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7db5348d-2f3b-4302-8ccb-dc0327b47dc0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.256610 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7db5348d-2f3b-4302-8ccb-dc0327b47dc0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.257322 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7db5348d-2f3b-4302-8ccb-dc0327b47dc0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.257733 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7db5348d-2f3b-4302-8ccb-dc0327b47dc0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.448014 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7db5348d-2f3b-4302-8ccb-dc0327b47dc0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:47.462898 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7db5348d-2f3b-4302-8ccb-dc0327b47dc0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.219292 Jul 21 22:35:47.463949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 172/317] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:47 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:47.610220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0c1088ba-dd2b-4b6b-9821-b5adaa3f985a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:47.610961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0c1088ba-dd2b-4b6b-9821-b5adaa3f985a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:47.618544 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0c1088ba-dd2b-4b6b-9821-b5adaa3f985a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.619086 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0c1088ba-dd2b-4b6b-9821-b5adaa3f985a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.619891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0c1088ba-dd2b-4b6b-9821-b5adaa3f985a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.620330 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0c1088ba-dd2b-4b6b-9821-b5adaa3f985a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.796813 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-0c1088ba-dd2b-4b6b-9821-b5adaa3f985a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:47.805591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0c1088ba-dd2b-4b6b-9821-b5adaa3f985a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.199202 Jul 21 22:35:47.806187 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 173/318] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:47 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:48.249443 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-78d4513f-a394-43e7-b1a4-3cb41afc5b3e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:48.250186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-78d4513f-a394-43e7-b1a4-3cb41afc5b3e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:48.257093 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-78d4513f-a394-43e7-b1a4-3cb41afc5b3e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.257542 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-78d4513f-a394-43e7-b1a4-3cb41afc5b3e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:48.258325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-78d4513f-a394-43e7-b1a4-3cb41afc5b3e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.258763 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-78d4513f-a394-43e7-b1a4-3cb41afc5b3e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:48.523574 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-78d4513f-a394-43e7-b1a4-3cb41afc5b3e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:48.540839 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-05efe0f1-12df-4443-aab2-50214e686043 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.679446 Jul 21 22:35:48.542351 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 146/319] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:35:39 2022] POST /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments => generated 194 bytes in 8684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:48.551725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-78d4513f-a394-43e7-b1a4-3cb41afc5b3e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:48.555983 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-78d4513f-a394-43e7-b1a4-3cb41afc5b3e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:48.556705 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-dc38c026-f04a-4eb0-bbd0-433737b8ddae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:48.557908 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-dc38c026-f04a-4eb0-bbd0-433737b8ddae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:48.559240 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-78d4513f-a394-43e7-b1a4-3cb41afc5b3e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1721 microversion: 2.20 time: 0.313656 Jul 21 22:35:48.562592 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 174/320] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:48 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:48.578359 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dc38c026-f04a-4eb0-bbd0-433737b8ddae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.578822 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dc38c026-f04a-4eb0-bbd0-433737b8ddae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:48.580333 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dc38c026-f04a-4eb0-bbd0-433737b8ddae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.580333 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dc38c026-f04a-4eb0-bbd0-433737b8ddae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:48.775180 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-dc38c026-f04a-4eb0-bbd0-433737b8ddae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:48.786626 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-dc38c026-f04a-4eb0-bbd0-433737b8ddae tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.241458 Jul 21 22:35:48.787382 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 147/321] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:48 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:48.823840 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1c5c3b8c-ddd1-4379-b2dc-1f16aa1f8716 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:48.824152 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1c5c3b8c-ddd1-4379-b2dc-1f16aa1f8716 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:48.836411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c5c3b8c-ddd1-4379-b2dc-1f16aa1f8716 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.837319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c5c3b8c-ddd1-4379-b2dc-1f16aa1f8716 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:48.838519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c5c3b8c-ddd1-4379-b2dc-1f16aa1f8716 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.839501 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c5c3b8c-ddd1-4379-b2dc-1f16aa1f8716 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:49.105927 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1c5c3b8c-ddd1-4379-b2dc-1f16aa1f8716 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:49.126714 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1c5c3b8c-ddd1-4379-b2dc-1f16aa1f8716 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.299966 Jul 21 22:35:49.140161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 175/322] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:48 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:49.529344 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-da7b752b-8f5d-478a-b9e9-ab94028c8a5a req-f57f169f-bc8e-4f1e-9c47-a0e204db0d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c323b31-2485-44f9-87e9-f2c4e8677f48", "tag": "b7065a68-717c-4122-b368-f36d2417f2f0"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:49.553514 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-da7b752b-8f5d-478a-b9e9-ab94028c8a5a req-f57f169f-bc8e-4f1e-9c47-a0e204db0d25 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:49.555782 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-da7b752b-8f5d-478a-b9e9-ab94028c8a5a req-f57f169f-bc8e-4f1e-9c47-a0e204db0d25 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:49.579478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-edf4fb9e-1aad-40cf-8f58-1e89b034cae3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:49.581066 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-edf4fb9e-1aad-40cf-8f58-1e89b034cae3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:49.589801 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-da7b752b-8f5d-478a-b9e9-ab94028c8a5a req-f57f169f-bc8e-4f1e-9c47-a0e204db0d25 service nova] Creating event network-changed:b7065a68-717c-4122-b368-f36d2417f2f0 for instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 on hv-cinder-85069 Jul 21 22:35:49.596432 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-da7b752b-8f5d-478a-b9e9-ab94028c8a5a req-f57f169f-bc8e-4f1e-9c47-a0e204db0d25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070809 Jul 21 22:35:49.598213 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-edf4fb9e-1aad-40cf-8f58-1e89b034cae3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:49.598661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-edf4fb9e-1aad-40cf-8f58-1e89b034cae3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:49.599678 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-edf4fb9e-1aad-40cf-8f58-1e89b034cae3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:49.600282 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-edf4fb9e-1aad-40cf-8f58-1e89b034cae3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:49.603741 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 148/323] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:49.805322 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b703671a-3f8b-471c-a763-f221c911e18c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:49.806303 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b703671a-3f8b-471c-a763-f221c911e18c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:49.813488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b703671a-3f8b-471c-a763-f221c911e18c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:49.814364 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b703671a-3f8b-471c-a763-f221c911e18c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:49.815745 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b703671a-3f8b-471c-a763-f221c911e18c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:49.816361 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b703671a-3f8b-471c-a763-f221c911e18c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:49.876392 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-edf4fb9e-1aad-40cf-8f58-1e89b034cae3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:49.896617 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-edf4fb9e-1aad-40cf-8f58-1e89b034cae3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:49.898898 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-edf4fb9e-1aad-40cf-8f58-1e89b034cae3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:49.901253 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-edf4fb9e-1aad-40cf-8f58-1e89b034cae3 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1664 microversion: 2.20 time: 0.325591 Jul 21 22:35:49.903019 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 176/324] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:49 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1664 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:49.921757 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c2854fda-ac0e-4975-a4f7-9383c90c802d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d39ac2df-88b2-4cb6-97c1-8956737307b6"}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:49.923023 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c2854fda-ac0e-4975-a4f7-9383c90c802d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:49.934050 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c2854fda-ac0e-4975-a4f7-9383c90c802d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:49.935853 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c2854fda-ac0e-4975-a4f7-9383c90c802d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:49.937472 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c2854fda-ac0e-4975-a4f7-9383c90c802d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:49.938638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c2854fda-ac0e-4975-a4f7-9383c90c802d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:50.008509 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b703671a-3f8b-471c-a763-f221c911e18c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:50.012590 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:50.025049 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b703671a-3f8b-471c-a763-f221c911e18c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.224591 Jul 21 22:35:50.026106 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 149/325] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:49 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:50.220263 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c2fd93b7-7f7f-4845-b9c1-cb139d82a98d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:50.221292 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c2fd93b7-7f7f-4845-b9c1-cb139d82a98d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:50.229957 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c2fd93b7-7f7f-4845-b9c1-cb139d82a98d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:50.230404 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c2fd93b7-7f7f-4845-b9c1-cb139d82a98d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:50.231232 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c2fd93b7-7f7f-4845-b9c1-cb139d82a98d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:50.231667 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c2fd93b7-7f7f-4845-b9c1-cb139d82a98d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:50.303498 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c2854fda-ac0e-4975-a4f7-9383c90c802d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "POST /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.385718 Jul 21 22:35:50.304126 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 177/326] 10.222.0.58 () {62 vars in 1363 bytes} [Thu Jul 21 22:35:49 2022] POST /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments => generated 188 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:35:50.405050 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c2fd93b7-7f7f-4845-b9c1-cb139d82a98d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:50.419729 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c2fd93b7-7f7f-4845-b9c1-cb139d82a98d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.206690 Jul 21 22:35:50.420918 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 150/327] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:50 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:50.481091 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-fede02b9-a648-462d-b995-bae3af42f330 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:50.481654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-fede02b9-a648-462d-b995-bae3af42f330 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:50.488535 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fede02b9-a648-462d-b995-bae3af42f330 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:50.489069 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fede02b9-a648-462d-b995-bae3af42f330 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:50.489841 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fede02b9-a648-462d-b995-bae3af42f330 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:50.490272 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fede02b9-a648-462d-b995-bae3af42f330 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:50.592492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-fede02b9-a648-462d-b995-bae3af42f330 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "POST /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/action" status: 202 len: 0 microversion: 2.20 time: 0.115566 Jul 21 22:35:50.593350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 178/328] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jul 21 22:35:50 2022] POST /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:35:50.601599 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7e133f35-59c4-4272-9502-908e9d58b5ba tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:50.602207 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7e133f35-59c4-4272-9502-908e9d58b5ba tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:50.610094 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7e133f35-59c4-4272-9502-908e9d58b5ba tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:50.610513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7e133f35-59c4-4272-9502-908e9d58b5ba tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:50.611848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7e133f35-59c4-4272-9502-908e9d58b5ba tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:50.612068 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7e133f35-59c4-4272-9502-908e9d58b5ba tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:50.780464 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7e133f35-59c4-4272-9502-908e9d58b5ba tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:50.793810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7e133f35-59c4-4272-9502-908e9d58b5ba tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:50.795386 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7e133f35-59c4-4272-9502-908e9d58b5ba tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:50.796583 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7e133f35-59c4-4272-9502-908e9d58b5ba tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1750 microversion: 2.20 time: 0.199459 Jul 21 22:35:50.797140 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 151/329] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:50 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1750 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:51.051637 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b73b9e2a-7602-46f3-afc2-39cbc28c6e2d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:51.052869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b73b9e2a-7602-46f3-afc2-39cbc28c6e2d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:51.061348 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b73b9e2a-7602-46f3-afc2-39cbc28c6e2d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.062022 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b73b9e2a-7602-46f3-afc2-39cbc28c6e2d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.063264 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b73b9e2a-7602-46f3-afc2-39cbc28c6e2d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.063778 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b73b9e2a-7602-46f3-afc2-39cbc28c6e2d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.280067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b73b9e2a-7602-46f3-afc2-39cbc28c6e2d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:51.291690 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b73b9e2a-7602-46f3-afc2-39cbc28c6e2d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.246127 Jul 21 22:35:51.292297 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 179/330] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:51 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:51.443706 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b2a9a23e-5528-4df9-8ff2-33e536db8f78 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:51.445153 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b2a9a23e-5528-4df9-8ff2-33e536db8f78 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:51.460769 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b2a9a23e-5528-4df9-8ff2-33e536db8f78 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.462055 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b2a9a23e-5528-4df9-8ff2-33e536db8f78 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.463676 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b2a9a23e-5528-4df9-8ff2-33e536db8f78 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.464700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b2a9a23e-5528-4df9-8ff2-33e536db8f78 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.637126 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b2a9a23e-5528-4df9-8ff2-33e536db8f78 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:51.647407 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b2a9a23e-5528-4df9-8ff2-33e536db8f78 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.212382 Jul 21 22:35:51.648200 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 152/331] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:51 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:51.820559 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2e4d775d-beae-4ceb-9d26-f6f4d2f7d266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:51.822669 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2e4d775d-beae-4ceb-9d26-f6f4d2f7d266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:51.830853 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e4d775d-beae-4ceb-9d26-f6f4d2f7d266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.831609 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e4d775d-beae-4ceb-9d26-f6f4d2f7d266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.834304 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e4d775d-beae-4ceb-9d26-f6f4d2f7d266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.835026 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e4d775d-beae-4ceb-9d26-f6f4d2f7d266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:52.003590 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2e4d775d-beae-4ceb-9d26-f6f4d2f7d266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:52.013777 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2e4d775d-beae-4ceb-9d26-f6f4d2f7d266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:52.015403 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2e4d775d-beae-4ceb-9d26-f6f4d2f7d266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:52.016598 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2e4d775d-beae-4ceb-9d26-f6f4d2f7d266 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1750 microversion: 2.20 time: 0.203570 Jul 21 22:35:52.017168 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 180/332] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:51 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1750 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:52.310158 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-74611475-5176-4cd7-9e43-98a00c74cbd9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:52.311521 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-74611475-5176-4cd7-9e43-98a00c74cbd9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:52.319553 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-74611475-5176-4cd7-9e43-98a00c74cbd9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:52.320361 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-74611475-5176-4cd7-9e43-98a00c74cbd9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:52.321387 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-74611475-5176-4cd7-9e43-98a00c74cbd9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:52.322058 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-74611475-5176-4cd7-9e43-98a00c74cbd9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:52.514899 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-74611475-5176-4cd7-9e43-98a00c74cbd9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:52.523279 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-74611475-5176-4cd7-9e43-98a00c74cbd9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.217335 Jul 21 22:35:52.523771 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 153/333] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:52 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:52.674993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4ff890e9-7a8c-489d-ac71-6c5a33cfbb4b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:52.675644 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4ff890e9-7a8c-489d-ac71-6c5a33cfbb4b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:52.683410 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ff890e9-7a8c-489d-ac71-6c5a33cfbb4b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:52.683853 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ff890e9-7a8c-489d-ac71-6c5a33cfbb4b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:52.684632 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ff890e9-7a8c-489d-ac71-6c5a33cfbb4b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:52.685057 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ff890e9-7a8c-489d-ac71-6c5a33cfbb4b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:52.855416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4ff890e9-7a8c-489d-ac71-6c5a33cfbb4b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:52.864718 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4ff890e9-7a8c-489d-ac71-6c5a33cfbb4b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.193767 Jul 21 22:35:52.865997 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 181/334] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:52 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:53.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-72e5a19a-ff0d-4328-ad7b-9ad5db53a1ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:53.039441 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-72e5a19a-ff0d-4328-ad7b-9ad5db53a1ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:53.046001 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72e5a19a-ff0d-4328-ad7b-9ad5db53a1ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:53.046454 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72e5a19a-ff0d-4328-ad7b-9ad5db53a1ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:53.047278 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72e5a19a-ff0d-4328-ad7b-9ad5db53a1ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:53.047719 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72e5a19a-ff0d-4328-ad7b-9ad5db53a1ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:53.231719 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-72e5a19a-ff0d-4328-ad7b-9ad5db53a1ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:53.241187 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-72e5a19a-ff0d-4328-ad7b-9ad5db53a1ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:53.242763 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-72e5a19a-ff0d-4328-ad7b-9ad5db53a1ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:53.244023 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-72e5a19a-ff0d-4328-ad7b-9ad5db53a1ff tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1752 microversion: 2.20 time: 0.210827 Jul 21 22:35:53.244589 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 154/335] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:53 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1752 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:53.541381 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9b7b2fe5-eb17-489b-b5d7-97f2f375d9e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:53.541986 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-9b7b2fe5-eb17-489b-b5d7-97f2f375d9e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:53.549373 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b7b2fe5-eb17-489b-b5d7-97f2f375d9e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:53.553012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b7b2fe5-eb17-489b-b5d7-97f2f375d9e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:53.554698 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b7b2fe5-eb17-489b-b5d7-97f2f375d9e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:53.555550 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b7b2fe5-eb17-489b-b5d7-97f2f375d9e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:53.637672 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-b71afb87-591a-4053-a9f2-64111c6b4a1f req-778a1afe-8d19-4e43-90ad-9ef07d43fa83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c214c984-d0d9-4920-882c-6b481647edc5", "name": "network-vif-plugged", "status": "completed", "tag": "2474b6a6-f120-434b-bba6-8abb5364b833"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:53.656373 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-b71afb87-591a-4053-a9f2-64111c6b4a1f req-778a1afe-8d19-4e43-90ad-9ef07d43fa83 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:53.657161 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-b71afb87-591a-4053-a9f2-64111c6b4a1f req-778a1afe-8d19-4e43-90ad-9ef07d43fa83 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:53.677004 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-b71afb87-591a-4053-a9f2-64111c6b4a1f req-778a1afe-8d19-4e43-90ad-9ef07d43fa83 service nova] Creating event network-vif-plugged:2474b6a6-f120-434b-bba6-8abb5364b833 for instance c214c984-d0d9-4920-882c-6b481647edc5 on hv-cinder-85069 Jul 21 22:35:53.682939 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-b71afb87-591a-4053-a9f2-64111c6b4a1f req-778a1afe-8d19-4e43-90ad-9ef07d43fa83 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053546 Jul 21 22:35:53.684098 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 155/336] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:53.784842 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-9b7b2fe5-eb17-489b-b5d7-97f2f375d9e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:53.792283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:53.811100 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-9b7b2fe5-eb17-489b-b5d7-97f2f375d9e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.273563 Jul 21 22:35:53.823864 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 182/337] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:53 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:53.883747 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d1426a2b-afeb-4400-8514-48dfe00f2a2a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:53.884561 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d1426a2b-afeb-4400-8514-48dfe00f2a2a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:53.897572 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1426a2b-afeb-4400-8514-48dfe00f2a2a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:53.898491 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1426a2b-afeb-4400-8514-48dfe00f2a2a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:53.900115 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1426a2b-afeb-4400-8514-48dfe00f2a2a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:53.900829 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1426a2b-afeb-4400-8514-48dfe00f2a2a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:54.113601 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d1426a2b-afeb-4400-8514-48dfe00f2a2a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:54.122070 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d1426a2b-afeb-4400-8514-48dfe00f2a2a tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.243738 Jul 21 22:35:54.122676 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 156/338] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:53 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:54.269300 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-30624cb5-df82-45a5-b1d1-a8a9f0c6d010 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:54.270654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-30624cb5-df82-45a5-b1d1-a8a9f0c6d010 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:54.278863 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-30624cb5-df82-45a5-b1d1-a8a9f0c6d010 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:54.279351 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-30624cb5-df82-45a5-b1d1-a8a9f0c6d010 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:54.280159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-30624cb5-df82-45a5-b1d1-a8a9f0c6d010 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:54.280600 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-30624cb5-df82-45a5-b1d1-a8a9f0c6d010 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:54.439609 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-30624cb5-df82-45a5-b1d1-a8a9f0c6d010 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:54.449575 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-30624cb5-df82-45a5-b1d1-a8a9f0c6d010 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:54.451120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-30624cb5-df82-45a5-b1d1-a8a9f0c6d010 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:54.452332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-30624cb5-df82-45a5-b1d1-a8a9f0c6d010 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1752 microversion: 2.20 time: 0.187453 Jul 21 22:35:54.452902 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 183/339] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:54 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:54.834055 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d9ac0cf3-43e6-4d7a-bded-73c611e6906e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:54.834674 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d9ac0cf3-43e6-4d7a-bded-73c611e6906e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:54.841663 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d9ac0cf3-43e6-4d7a-bded-73c611e6906e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:54.842101 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d9ac0cf3-43e6-4d7a-bded-73c611e6906e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:54.842869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d9ac0cf3-43e6-4d7a-bded-73c611e6906e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:54.843329 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d9ac0cf3-43e6-4d7a-bded-73c611e6906e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:54.993282 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d9ac0cf3-43e6-4d7a-bded-73c611e6906e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:55.001844 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d9ac0cf3-43e6-4d7a-bded-73c611e6906e tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1370 microversion: 2.1 time: 0.172749 Jul 21 22:35:55.002444 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 157/340] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:54 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:55.139550 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9038c105-93e5-4971-b3f0-fb9ec8bc888d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:55.140192 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-9038c105-93e5-4971-b3f0-fb9ec8bc888d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:55.146720 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9038c105-93e5-4971-b3f0-fb9ec8bc888d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:55.147203 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9038c105-93e5-4971-b3f0-fb9ec8bc888d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:55.147995 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9038c105-93e5-4971-b3f0-fb9ec8bc888d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:55.148439 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9038c105-93e5-4971-b3f0-fb9ec8bc888d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:55.337341 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-9038c105-93e5-4971-b3f0-fb9ec8bc888d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:55.347449 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-9038c105-93e5-4971-b3f0-fb9ec8bc888d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.211498 Jul 21 22:35:55.348851 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 184/341] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:55 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:55.471087 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-873ae153-7bb9-435c-b535-46e9c5c68ab1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:55.472089 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-873ae153-7bb9-435c-b535-46e9c5c68ab1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:55.478352 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-873ae153-7bb9-435c-b535-46e9c5c68ab1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:55.478738 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-873ae153-7bb9-435c-b535-46e9c5c68ab1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:55.479856 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-873ae153-7bb9-435c-b535-46e9c5c68ab1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:55.480294 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-873ae153-7bb9-435c-b535-46e9c5c68ab1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:55.669092 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-873ae153-7bb9-435c-b535-46e9c5c68ab1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:55.680095 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-873ae153-7bb9-435c-b535-46e9c5c68ab1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:55.681792 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-873ae153-7bb9-435c-b535-46e9c5c68ab1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:55.683162 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-873ae153-7bb9-435c-b535-46e9c5c68ab1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1752 microversion: 2.20 time: 0.216326 Jul 21 22:35:55.683737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 158/342] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:55 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1752 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:55.705972 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-e8b263fe-2599-48a2-a7a8-958604f8bb62 req-1291613e-3da1-493f-ae47-cdcb5b189f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c323b31-2485-44f9-87e9-f2c4e8677f48", "name": "network-vif-plugged", "status": "completed", "tag": "b7065a68-717c-4122-b368-f36d2417f2f0"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:55.714946 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-e8b263fe-2599-48a2-a7a8-958604f8bb62 req-1291613e-3da1-493f-ae47-cdcb5b189f53 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:55.715401 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-e8b263fe-2599-48a2-a7a8-958604f8bb62 req-1291613e-3da1-493f-ae47-cdcb5b189f53 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:55.727941 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-e8b263fe-2599-48a2-a7a8-958604f8bb62 req-1291613e-3da1-493f-ae47-cdcb5b189f53 service nova] Creating event network-vif-plugged:b7065a68-717c-4122-b368-f36d2417f2f0 for instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 on hv-cinder-85069 Jul 21 22:35:55.733266 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-e8b263fe-2599-48a2-a7a8-958604f8bb62 req-1291613e-3da1-493f-ae47-cdcb5b189f53 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031066 Jul 21 22:35:55.733872 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 185/343] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:35:56.027357 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8a36daae-d2bf-45fc-befb-5b5603891999 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:56.027972 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-8a36daae-d2bf-45fc-befb-5b5603891999 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:56.034762 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8a36daae-d2bf-45fc-befb-5b5603891999 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.035280 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8a36daae-d2bf-45fc-befb-5b5603891999 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.036063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8a36daae-d2bf-45fc-befb-5b5603891999 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.036603 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8a36daae-d2bf-45fc-befb-5b5603891999 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.216130 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8a36daae-d2bf-45fc-befb-5b5603891999 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:56.229245 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8a36daae-d2bf-45fc-befb-5b5603891999 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1565 microversion: 2.1 time: 0.205673 Jul 21 22:35:56.230056 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 159/344] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:56 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1565 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:56.250481 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-00d2c813-8901-44c8-826f-2c2bed1a7bc3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:56.251146 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-00d2c813-8901-44c8-826f-2c2bed1a7bc3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:56.259612 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-00d2c813-8901-44c8-826f-2c2bed1a7bc3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.260065 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-00d2c813-8901-44c8-826f-2c2bed1a7bc3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.260856 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-00d2c813-8901-44c8-826f-2c2bed1a7bc3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.261319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-00d2c813-8901-44c8-826f-2c2bed1a7bc3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.353637 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-00d2c813-8901-44c8-826f-2c2bed1a7bc3 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108944 Jul 21 22:35:56.354716 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 186/345] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 22:35:56 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:56.368441 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-44c3f947-5767-47f9-9312-1826e61888b8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:56.369051 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-44c3f947-5767-47f9-9312-1826e61888b8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:56.375847 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44c3f947-5767-47f9-9312-1826e61888b8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.376295 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44c3f947-5767-47f9-9312-1826e61888b8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.377080 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44c3f947-5767-47f9-9312-1826e61888b8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.377515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44c3f947-5767-47f9-9312-1826e61888b8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.709633 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b1793ffe-28d8-4d31-a89a-c5265b8d30af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:56.711019 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b1793ffe-28d8-4d31-a89a-c5265b8d30af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:56.712546 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-44c3f947-5767-47f9-9312-1826e61888b8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:56.731360 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:56.732780 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-44c3f947-5767-47f9-9312-1826e61888b8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.369425 Jul 21 22:35:56.736757 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b1793ffe-28d8-4d31-a89a-c5265b8d30af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.744885 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 160/346] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:56 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:56.746322 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b1793ffe-28d8-4d31-a89a-c5265b8d30af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.747644 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b1793ffe-28d8-4d31-a89a-c5265b8d30af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.748342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b1793ffe-28d8-4d31-a89a-c5265b8d30af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:57.098018 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b1793ffe-28d8-4d31-a89a-c5265b8d30af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:57.109976 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b1793ffe-28d8-4d31-a89a-c5265b8d30af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:57.111935 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b1793ffe-28d8-4d31-a89a-c5265b8d30af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:57.113351 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b1793ffe-28d8-4d31-a89a-c5265b8d30af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1752 microversion: 2.20 time: 0.410706 Jul 21 22:35:57.114463 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 187/347] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:56 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1752 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:57.395745 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1e729bf5-8b66-424b-9912-a0a5aad7d80c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: .version_select at 0x7f47e6924ee0>, body: {"keypair": {"name": "tempest-keypair-650590918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGj/wHeWOW02LieYe6UuHgw1MLBd+Fxl8oE1zt+JYBt6bGwQAylZCd9mhQWD1Ek1NCYb8dbyiwvPfZUEZGIpdqX0Dm5UekkW7Ep0w8EBP49gwTknnllW/KkqJWnTjK2wg=="}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:57.411405 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-1e729bf5-8b66-424b-9912-a0a5aad7d80c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:35:57.416439 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-1e729bf5-8b66-424b-9912-a0a5aad7d80c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for user c4284eb173fc49d1b059fdd2f3de2b4d and project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:35:57.445825 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1e729bf5-8b66-424b-9912-a0a5aad7d80c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054811 Jul 21 22:35:57.446331 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 161/348] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 22:35:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:57.773494 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e19f0260-08dc-4cca-8dac-4c12e8211945 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:57.776171 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e19f0260-08dc-4cca-8dac-4c12e8211945 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:57.798999 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e19f0260-08dc-4cca-8dac-4c12e8211945 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:57.799293 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e19f0260-08dc-4cca-8dac-4c12e8211945 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:57.800059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e19f0260-08dc-4cca-8dac-4c12e8211945 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:57.800863 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e19f0260-08dc-4cca-8dac-4c12e8211945 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:58.079212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e19f0260-08dc-4cca-8dac-4c12e8211945 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:58.093167 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e19f0260-08dc-4cca-8dac-4c12e8211945 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1358 microversion: 2.1 time: 0.342515 Jul 21 22:35:58.103889 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 188/349] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:57 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:58.135506 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c916cdb3-10aa-440a-9c40-2f19a131032e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:58.136123 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c916cdb3-10aa-440a-9c40-2f19a131032e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:58.144936 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c916cdb3-10aa-440a-9c40-2f19a131032e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:58.145790 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c916cdb3-10aa-440a-9c40-2f19a131032e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:58.146828 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c916cdb3-10aa-440a-9c40-2f19a131032e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:58.147473 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c916cdb3-10aa-440a-9c40-2f19a131032e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:58.249390 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-6ed12597-f3a1-4584-a854-2383507e4408 req-1da057e4-4c36-4ec2-b56b-4090a96e8f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c214c984-d0d9-4920-882c-6b481647edc5", "tag": "2474b6a6-f120-434b-bba6-8abb5364b833"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:58.259411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-6ed12597-f3a1-4584-a854-2383507e4408 req-1da057e4-4c36-4ec2-b56b-4090a96e8f5c service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:58.260228 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-6ed12597-f3a1-4584-a854-2383507e4408 req-1da057e4-4c36-4ec2-b56b-4090a96e8f5c service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:58.275475 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-6ed12597-f3a1-4584-a854-2383507e4408 req-1da057e4-4c36-4ec2-b56b-4090a96e8f5c service nova] Creating event network-changed:2474b6a6-f120-434b-bba6-8abb5364b833 for instance c214c984-d0d9-4920-882c-6b481647edc5 on hv-cinder-85069 Jul 21 22:35:58.281159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-6ed12597-f3a1-4584-a854-2383507e4408 req-1da057e4-4c36-4ec2-b56b-4090a96e8f5c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035452 Jul 21 22:35:58.282614 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 189/350] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:35:58.403960 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c916cdb3-10aa-440a-9c40-2f19a131032e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:58.437582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c916cdb3-10aa-440a-9c40-2f19a131032e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:58.443955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c916cdb3-10aa-440a-9c40-2f19a131032e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:58.448587 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c916cdb3-10aa-440a-9c40-2f19a131032e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.315576 Jul 21 22:35:58.475238 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 162/351] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:58 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:59.125479 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-818950da-1389-46a0-b051-e9554994f8a7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:59.126781 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-818950da-1389-46a0-b051-e9554994f8a7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:59.139587 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-818950da-1389-46a0-b051-e9554994f8a7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.142031 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-818950da-1389-46a0-b051-e9554994f8a7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.144639 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-818950da-1389-46a0-b051-e9554994f8a7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.146192 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-818950da-1389-46a0-b051-e9554994f8a7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.375972 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-818950da-1389-46a0-b051-e9554994f8a7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:59.390899 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-818950da-1389-46a0-b051-e9554994f8a7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1548 microversion: 2.1 time: 0.273885 Jul 21 22:35:59.391546 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 190/352] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:59 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1548 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:59.413583 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f5ad92e3-4851-416e-a478-d5a9b74891fd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:59.414921 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f5ad92e3-4851-416e-a478-d5a9b74891fd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:59.422272 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f5ad92e3-4851-416e-a478-d5a9b74891fd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.422884 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f5ad92e3-4851-416e-a478-d5a9b74891fd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.423849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f5ad92e3-4851-416e-a478-d5a9b74891fd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.424396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f5ad92e3-4851-416e-a478-d5a9b74891fd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.481196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c882858e-fd0b-4cf3-af11-49960eb5b9af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:59.482319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c882858e-fd0b-4cf3-af11-49960eb5b9af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:59.490090 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c882858e-fd0b-4cf3-af11-49960eb5b9af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.490953 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c882858e-fd0b-4cf3-af11-49960eb5b9af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.492171 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c882858e-fd0b-4cf3-af11-49960eb5b9af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.492603 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c882858e-fd0b-4cf3-af11-49960eb5b9af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.647665 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f5ad92e3-4851-416e-a478-d5a9b74891fd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:59.669840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f5ad92e3-4851-416e-a478-d5a9b74891fd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1548 microversion: 2.1 time: 0.262556 Jul 21 22:35:59.670847 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 163/353] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:59 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1548 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:59.701096 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-600a5320-1eba-499f-a537-017440264e42 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:59.713280 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-600a5320-1eba-499f-a537-017440264e42 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:59.715088 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-600a5320-1eba-499f-a537-017440264e42 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Searching by: {'deleted': False, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2'} {{(pid=124497) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 22:35:59.730135 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-600a5320-1eba-499f-a537-017440264e42 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.731283 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-600a5320-1eba-499f-a537-017440264e42 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.732970 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-600a5320-1eba-499f-a537-017440264e42 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.733952 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-600a5320-1eba-499f-a537-017440264e42 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.750254 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c882858e-fd0b-4cf3-af11-49960eb5b9af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:59.774921 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c882858e-fd0b-4cf3-af11-49960eb5b9af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:59.779504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c882858e-fd0b-4cf3-af11-49960eb5b9af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:59.783962 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c882858e-fd0b-4cf3-af11-49960eb5b9af tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.306305 Jul 21 22:35:59.804296 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 191/354] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:59 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:59.918219 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.multi_cell_list [None req-600a5320-1eba-499f-a537-017440264e42 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124497) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 22:36:00.076744 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-600a5320-1eba-499f-a537-017440264e42 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.382697 Jul 21 22:36:00.078195 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 164/355] 10.222.0.58 () {58 vars in 1124 bytes} [Thu Jul 21 22:35:59 2022] GET /compute/v2.1/servers => generated 342 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:00.091523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5f0a8bb5-758d-4419-850c-6add06bd40f0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:00.092724 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-5f0a8bb5-758d-4419-850c-6add06bd40f0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:00.100834 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5f0a8bb5-758d-4419-850c-6add06bd40f0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:00.101615 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5f0a8bb5-758d-4419-850c-6add06bd40f0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:00.102653 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5f0a8bb5-758d-4419-850c-6add06bd40f0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:00.103115 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5f0a8bb5-758d-4419-850c-6add06bd40f0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:00.160354 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-292591947", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f846e054-e088-4d42-aada-300493577c1f"}], "security_groups": [{"name": "tempest-securitygroup--1227730954"}], "key_name": "tempest-keypair-650590918", "user_data": "}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:00.295655 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5f0a8bb5-758d-4419-850c-6add06bd40f0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:00.312656 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5f0a8bb5-758d-4419-850c-6add06bd40f0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1548 microversion: 2.1 time: 0.226406 Jul 21 22:36:00.313649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 192/356] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:00 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:00.337823 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] validate_networks() for [('f846e054-e088-4d42-aada-300493577c1f', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:36:00.816304 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d2238268-12b3-4fb0-ad3f-237b1f17be0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:00.816970 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d2238268-12b3-4fb0-ad3f-237b1f17be0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:00.824133 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d2238268-12b3-4fb0-ad3f-237b1f17be0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:00.824608 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d2238268-12b3-4fb0-ad3f-237b1f17be0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:00.825776 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d2238268-12b3-4fb0-ad3f-237b1f17be0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:00.826221 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d2238268-12b3-4fb0-ad3f-237b1f17be0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:00.989404 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:36:00.990441 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:36:00.991159 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:36:00.991760 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:36:00.992333 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:36:01.004488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:01.005368 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:01.006511 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:01.007550 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:01.033099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:36:01.042636 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for user c4284eb173fc49d1b059fdd2f3de2b4d and project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:36:01.058371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:36:01.061493 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:36:01.061802 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d2238268-12b3-4fb0-ad3f-237b1f17be0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:01.082586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d2238268-12b3-4fb0-ad3f-237b1f17be0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:01.084447 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d2238268-12b3-4fb0-ad3f-237b1f17be0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:01.085813 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d2238268-12b3-4fb0-ad3f-237b1f17be0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.273988 Jul 21 22:36:01.096778 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 193/357] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:00 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:01.117773 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:01.154485 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3f7173b9-b8d5-42b3-9715-a2e398d26348 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.004405 Jul 21 22:36:01.155730 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 165/358] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:36:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:36:01.166941 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9f8bce76-b708-47eb-8a08-2d533aaa2745 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:01.167842 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-9f8bce76-b708-47eb-8a08-2d533aaa2745 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:01.253291 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-9f8bce76-b708-47eb-8a08-2d533aaa2745 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:01.265353 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-9f8bce76-b708-47eb-8a08-2d533aaa2745 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1240 microversion: 2.1 time: 0.102578 Jul 21 22:36:01.267600 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 194/359] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:01 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1240 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:02.095975 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a69040fc-3b71-4b35-a8f5-e1a65725fead tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db73042f-3f49-46ba-8578-e80f5ab997f0"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:02.099942 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a69040fc-3b71-4b35-a8f5-e1a65725fead tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:02.110080 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-43b9237f-b0c6-468d-a8f9-f6844d1974f9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:02.112227 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-43b9237f-b0c6-468d-a8f9-f6844d1974f9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:02.121365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a69040fc-3b71-4b35-a8f5-e1a65725fead tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:02.122261 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a69040fc-3b71-4b35-a8f5-e1a65725fead tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:02.123432 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a69040fc-3b71-4b35-a8f5-e1a65725fead tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:02.124085 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a69040fc-3b71-4b35-a8f5-e1a65725fead tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:02.129701 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43b9237f-b0c6-468d-a8f9-f6844d1974f9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:02.130587 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43b9237f-b0c6-468d-a8f9-f6844d1974f9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:02.132203 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43b9237f-b0c6-468d-a8f9-f6844d1974f9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:02.133023 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43b9237f-b0c6-468d-a8f9-f6844d1974f9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:02.383634 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-43b9237f-b0c6-468d-a8f9-f6844d1974f9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:02.403651 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-43b9237f-b0c6-468d-a8f9-f6844d1974f9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:02.407238 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-43b9237f-b0c6-468d-a8f9-f6844d1974f9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:02.409683 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-43b9237f-b0c6-468d-a8f9-f6844d1974f9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.308488 Jul 21 22:36:02.420894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 195/360] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:02 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:02.420894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-73e9e778-7ac1-4632-abc7-41a31153961e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:02.421409 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-73e9e778-7ac1-4632-abc7-41a31153961e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:02.433663 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-73e9e778-7ac1-4632-abc7-41a31153961e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:02.434762 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-73e9e778-7ac1-4632-abc7-41a31153961e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:02.436157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-73e9e778-7ac1-4632-abc7-41a31153961e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:02.436943 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-73e9e778-7ac1-4632-abc7-41a31153961e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:02.543090 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-73e9e778-7ac1-4632-abc7-41a31153961e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:02.552112 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-73e9e778-7ac1-4632-abc7-41a31153961e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1244 microversion: 2.1 time: 0.135418 Jul 21 22:36:02.552802 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 196/361] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:02 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1244 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:03.444471 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d3d9fc37-9809-4bcb-8ea1-7dd039371afa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:03.445565 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d3d9fc37-9809-4bcb-8ea1-7dd039371afa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:03.453074 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d3d9fc37-9809-4bcb-8ea1-7dd039371afa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:03.453514 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d3d9fc37-9809-4bcb-8ea1-7dd039371afa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:03.454306 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d3d9fc37-9809-4bcb-8ea1-7dd039371afa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:03.454776 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d3d9fc37-9809-4bcb-8ea1-7dd039371afa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:03.645697 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d3d9fc37-9809-4bcb-8ea1-7dd039371afa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:03.655525 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d3d9fc37-9809-4bcb-8ea1-7dd039371afa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:03.657245 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d3d9fc37-9809-4bcb-8ea1-7dd039371afa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:03.658513 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d3d9fc37-9809-4bcb-8ea1-7dd039371afa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.221250 Jul 21 22:36:03.667661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 197/362] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:03 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:03.672914 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-618136a4-f358-4af1-81d1-b5dde024ec04 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:03.673525 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-618136a4-f358-4af1-81d1-b5dde024ec04 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:03.681963 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-618136a4-f358-4af1-81d1-b5dde024ec04 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:03.682419 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-618136a4-f358-4af1-81d1-b5dde024ec04 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:03.683286 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-618136a4-f358-4af1-81d1-b5dde024ec04 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:03.683808 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-618136a4-f358-4af1-81d1-b5dde024ec04 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:03.786914 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-618136a4-f358-4af1-81d1-b5dde024ec04 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:03.800195 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-618136a4-f358-4af1-81d1-b5dde024ec04 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1244 microversion: 2.1 time: 0.130686 Jul 21 22:36:03.801717 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 198/363] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:03 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1244 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:04.680333 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a1abde4c-0cd4-4407-8b57-f6761caa8096 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:04.681049 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a1abde4c-0cd4-4407-8b57-f6761caa8096 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:04.687601 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a1abde4c-0cd4-4407-8b57-f6761caa8096 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:04.688050 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a1abde4c-0cd4-4407-8b57-f6761caa8096 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:04.688828 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a1abde4c-0cd4-4407-8b57-f6761caa8096 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:04.689260 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a1abde4c-0cd4-4407-8b57-f6761caa8096 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:04.848070 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a1abde4c-0cd4-4407-8b57-f6761caa8096 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:04.857643 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a1abde4c-0cd4-4407-8b57-f6761caa8096 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:04.859191 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a1abde4c-0cd4-4407-8b57-f6761caa8096 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:04.860366 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a1abde4c-0cd4-4407-8b57-f6761caa8096 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.185664 Jul 21 22:36:04.860939 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 199/364] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:04 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:04.866523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7658868a-99d3-4981-9939-e259a473cfb9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:04.867159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7658868a-99d3-4981-9939-e259a473cfb9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:04.874115 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7658868a-99d3-4981-9939-e259a473cfb9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:04.874555 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7658868a-99d3-4981-9939-e259a473cfb9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:04.875388 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7658868a-99d3-4981-9939-e259a473cfb9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:04.875822 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7658868a-99d3-4981-9939-e259a473cfb9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:04.962083 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7658868a-99d3-4981-9939-e259a473cfb9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:04.970289 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7658868a-99d3-4981-9939-e259a473cfb9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1244 microversion: 2.1 time: 0.108194 Jul 21 22:36:04.970803 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 200/365] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:04 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:05.891115 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1bdd96fb-12a9-41ac-92bd-4f91064b6a1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:05.892093 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1bdd96fb-12a9-41ac-92bd-4f91064b6a1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:05.903457 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1bdd96fb-12a9-41ac-92bd-4f91064b6a1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:05.904434 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1bdd96fb-12a9-41ac-92bd-4f91064b6a1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:05.905769 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1bdd96fb-12a9-41ac-92bd-4f91064b6a1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:05.906496 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1bdd96fb-12a9-41ac-92bd-4f91064b6a1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.093960 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1bdd96fb-12a9-41ac-92bd-4f91064b6a1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:06.104236 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1bdd96fb-12a9-41ac-92bd-4f91064b6a1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:06.106027 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1bdd96fb-12a9-41ac-92bd-4f91064b6a1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:06.107404 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1bdd96fb-12a9-41ac-92bd-4f91064b6a1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.224936 Jul 21 22:36:06.108443 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 201/366] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:05 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:06.113517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ab6a9f03-6193-42a5-b665-eafeed66e291 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:06.114259 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ab6a9f03-6193-42a5-b665-eafeed66e291 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:06.120925 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ab6a9f03-6193-42a5-b665-eafeed66e291 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.121450 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ab6a9f03-6193-42a5-b665-eafeed66e291 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.122390 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ab6a9f03-6193-42a5-b665-eafeed66e291 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.122829 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ab6a9f03-6193-42a5-b665-eafeed66e291 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.126008 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=100 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:06.226443 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ab6a9f03-6193-42a5-b665-eafeed66e291 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:06.238866 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ab6a9f03-6193-42a5-b665-eafeed66e291 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1244 microversion: 2.1 time: 0.129135 Jul 21 22:36:06.249040 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 202/367] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:06 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1244 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:06.758838 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d06be0e4-ceed-42db-a448-e56408363aac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:06.771789 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d06be0e4-ceed-42db-a448-e56408363aac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:06.784131 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d06be0e4-ceed-42db-a448-e56408363aac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.785519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d06be0e4-ceed-42db-a448-e56408363aac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.787043 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d06be0e4-ceed-42db-a448-e56408363aac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.787894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d06be0e4-ceed-42db-a448-e56408363aac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.983089 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-d06be0e4-ceed-42db-a448-e56408363aac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lazy-loading 'services' on Instance uuid ffa905ed-e5e9-4837-8aca-77fff9f6d722 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:36:07.158249 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d06be0e4-ceed-42db-a448-e56408363aac tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/os-volume_attachments/a46eb20d-5cae-4893-a3ff-942ccf6554ba" status: 202 len: 0 microversion: 2.1 time: 0.409371 Jul 21 22:36:07.165723 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 203/368] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:36:06 2022] DELETE /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/os-volume_attachments/a46eb20d-5cae-4893-a3ff-942ccf6554ba => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:36:07.172794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-91181645-ceb2-4482-a83f-ccfccd142907 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:07.174043 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-91181645-ceb2-4482-a83f-ccfccd142907 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:07.195101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-91181645-ceb2-4482-a83f-ccfccd142907 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:07.195101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-91181645-ceb2-4482-a83f-ccfccd142907 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:07.195101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-91181645-ceb2-4482-a83f-ccfccd142907 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:07.195101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-91181645-ceb2-4482-a83f-ccfccd142907 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:07.471504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-91181645-ceb2-4482-a83f-ccfccd142907 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:07.491131 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-91181645-ceb2-4482-a83f-ccfccd142907 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:07.494249 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-91181645-ceb2-4482-a83f-ccfccd142907 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:07.496378 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-91181645-ceb2-4482-a83f-ccfccd142907 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.334821 Jul 21 22:36:07.506346 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 204/369] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:07 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:07.507048 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8394a187-797f-4ebf-b4ea-f3e0098d4509 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:07.508152 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8394a187-797f-4ebf-b4ea-f3e0098d4509 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:07.520336 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8394a187-797f-4ebf-b4ea-f3e0098d4509 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:07.521116 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8394a187-797f-4ebf-b4ea-f3e0098d4509 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:07.522504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8394a187-797f-4ebf-b4ea-f3e0098d4509 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:07.523309 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8394a187-797f-4ebf-b4ea-f3e0098d4509 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:07.612681 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8394a187-797f-4ebf-b4ea-f3e0098d4509 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:07.629210 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8394a187-797f-4ebf-b4ea-f3e0098d4509 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1244 microversion: 2.1 time: 0.129706 Jul 21 22:36:07.630025 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 205/370] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:07 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1244 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:08.516522 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-67b95813-71a7-4e97-a27b-550bb5e7cee2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:08.517313 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-67b95813-71a7-4e97-a27b-550bb5e7cee2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:08.524943 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-67b95813-71a7-4e97-a27b-550bb5e7cee2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:08.525380 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-67b95813-71a7-4e97-a27b-550bb5e7cee2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:08.526143 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-67b95813-71a7-4e97-a27b-550bb5e7cee2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:08.526632 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-67b95813-71a7-4e97-a27b-550bb5e7cee2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:08.680416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-67b95813-71a7-4e97-a27b-550bb5e7cee2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:08.691608 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-67b95813-71a7-4e97-a27b-550bb5e7cee2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:08.695291 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-67b95813-71a7-4e97-a27b-550bb5e7cee2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:08.697426 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-67b95813-71a7-4e97-a27b-550bb5e7cee2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.184621 Jul 21 22:36:08.698609 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 206/371] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:08 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:08.710216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-bbbbd610-f5ca-45b7-830c-4921f1c2e4d2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:08.710216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-bbbbd610-f5ca-45b7-830c-4921f1c2e4d2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:08.719845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bbbbd610-f5ca-45b7-830c-4921f1c2e4d2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:08.720614 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bbbbd610-f5ca-45b7-830c-4921f1c2e4d2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:08.721979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bbbbd610-f5ca-45b7-830c-4921f1c2e4d2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:08.722820 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bbbbd610-f5ca-45b7-830c-4921f1c2e4d2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:08.833768 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-bbbbd610-f5ca-45b7-830c-4921f1c2e4d2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:08.842269 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-bbbbd610-f5ca-45b7-830c-4921f1c2e4d2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1244 microversion: 2.1 time: 0.142154 Jul 21 22:36:08.843337 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 207/372] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:08 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1244 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:09.721133 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5173ec22-de56-4b08-af55-1fa7d037b262 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:09.721900 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-5173ec22-de56-4b08-af55-1fa7d037b262 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:09.734708 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5173ec22-de56-4b08-af55-1fa7d037b262 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:09.735190 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5173ec22-de56-4b08-af55-1fa7d037b262 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:09.735970 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5173ec22-de56-4b08-af55-1fa7d037b262 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:09.736410 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5173ec22-de56-4b08-af55-1fa7d037b262 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:09.880384 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5173ec22-de56-4b08-af55-1fa7d037b262 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:09.888729 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5173ec22-de56-4b08-af55-1fa7d037b262 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:09.890219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5173ec22-de56-4b08-af55-1fa7d037b262 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:09.891382 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5173ec22-de56-4b08-af55-1fa7d037b262 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.174594 Jul 21 22:36:09.891926 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 208/373] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:09 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:09.897152 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3bb399cd-11b0-4ba3-bfd3-43ac6023a0e0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:09.897741 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3bb399cd-11b0-4ba3-bfd3-43ac6023a0e0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:09.903858 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3bb399cd-11b0-4ba3-bfd3-43ac6023a0e0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:09.904294 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3bb399cd-11b0-4ba3-bfd3-43ac6023a0e0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:09.905053 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3bb399cd-11b0-4ba3-bfd3-43ac6023a0e0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:09.905477 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3bb399cd-11b0-4ba3-bfd3-43ac6023a0e0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:09.978658 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3bb399cd-11b0-4ba3-bfd3-43ac6023a0e0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:09.986411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3bb399cd-11b0-4ba3-bfd3-43ac6023a0e0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1244 microversion: 2.1 time: 0.093422 Jul 21 22:36:09.987003 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 209/374] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:09 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:10.337467 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a69040fc-3b71-4b35-a8f5-e1a65725fead tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "POST /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.259221 Jul 21 22:36:10.338270 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 166/375] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:36:02 2022] POST /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/os-volume_attachments => generated 194 bytes in 8261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:10.909820 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a8f23468-1f02-4442-bd28-da95fff57198 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:10.910429 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a8f23468-1f02-4442-bd28-da95fff57198 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:10.916354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a8f23468-1f02-4442-bd28-da95fff57198 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:10.916796 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a8f23468-1f02-4442-bd28-da95fff57198 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:10.917555 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a8f23468-1f02-4442-bd28-da95fff57198 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:10.917992 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a8f23468-1f02-4442-bd28-da95fff57198 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:11.005618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-44e3dd27-f1e6-42e6-8fdc-8b77ce75e65a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:11.006424 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-44e3dd27-f1e6-42e6-8fdc-8b77ce75e65a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:11.013397 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44e3dd27-f1e6-42e6-8fdc-8b77ce75e65a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:11.013843 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44e3dd27-f1e6-42e6-8fdc-8b77ce75e65a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:11.014624 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44e3dd27-f1e6-42e6-8fdc-8b77ce75e65a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:11.015090 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-44e3dd27-f1e6-42e6-8fdc-8b77ce75e65a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:11.017836 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:11.021368 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=4 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:11.053265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a8f23468-1f02-4442-bd28-da95fff57198 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:11.053490 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=10 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:11.062281 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a8f23468-1f02-4442-bd28-da95fff57198 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:11.063877 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a8f23468-1f02-4442-bd28-da95fff57198 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:11.065054 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a8f23468-1f02-4442-bd28-da95fff57198 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.159245 Jul 21 22:36:11.065623 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 210/376] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:10 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:11.083625 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-44e3dd27-f1e6-42e6-8fdc-8b77ce75e65a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:11.099528 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-44e3dd27-f1e6-42e6-8fdc-8b77ce75e65a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1292 microversion: 2.1 time: 0.099184 Jul 21 22:36:11.100133 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 167/377] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:10 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:12.085099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e21f0260-5245-4a72-80b3-538bd9852c2f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:12.085789 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e21f0260-5245-4a72-80b3-538bd9852c2f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:12.087933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:12.093806 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e21f0260-5245-4a72-80b3-538bd9852c2f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.094329 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e21f0260-5245-4a72-80b3-538bd9852c2f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.095245 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e21f0260-5245-4a72-80b3-538bd9852c2f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.095745 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e21f0260-5245-4a72-80b3-538bd9852c2f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.117919 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7215caa2-3bf6-425a-80f7-94760646bd3d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:12.118623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7215caa2-3bf6-425a-80f7-94760646bd3d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:12.125257 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7215caa2-3bf6-425a-80f7-94760646bd3d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.125846 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7215caa2-3bf6-425a-80f7-94760646bd3d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.126703 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7215caa2-3bf6-425a-80f7-94760646bd3d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.127245 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7215caa2-3bf6-425a-80f7-94760646bd3d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.205638 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7215caa2-3bf6-425a-80f7-94760646bd3d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:12.216277 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7215caa2-3bf6-425a-80f7-94760646bd3d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1298 microversion: 2.1 time: 0.103048 Jul 21 22:36:12.217828 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 168/378] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:12 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:12.255174 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e21f0260-5245-4a72-80b3-538bd9852c2f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:12.265079 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e21f0260-5245-4a72-80b3-538bd9852c2f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:12.266857 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e21f0260-5245-4a72-80b3-538bd9852c2f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:12.268558 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e21f0260-5245-4a72-80b3-538bd9852c2f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.187366 Jul 21 22:36:12.269005 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 211/379] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:12 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:12.612022 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5df6bb46-088a-48a2-a49f-9ddfa962073a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:12.618695 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5df6bb46-088a-48a2-a49f-9ddfa962073a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.619185 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5df6bb46-088a-48a2-a49f-9ddfa962073a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.642654 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5df6bb46-088a-48a2-a49f-9ddfa962073a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Going to try to stop instance {{(pid=124497) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 22:36:12.693738 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-5df6bb46-088a-48a2-a49f-9ddfa962073a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "POST /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/action" status: 202 len: 0 microversion: 2.1 time: 0.090278 Jul 21 22:36:12.694356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 169/380] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:36:12 2022] POST /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:36:12.705087 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-10aeb10e-9cda-41f8-ac40-43375f546dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:12.705875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-10aeb10e-9cda-41f8-ac40-43375f546dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:12.713231 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-10aeb10e-9cda-41f8-ac40-43375f546dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.713752 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-10aeb10e-9cda-41f8-ac40-43375f546dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.714694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-10aeb10e-9cda-41f8-ac40-43375f546dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.715638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-10aeb10e-9cda-41f8-ac40-43375f546dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.884310 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-10aeb10e-9cda-41f8-ac40-43375f546dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:12.892312 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-10aeb10e-9cda-41f8-ac40-43375f546dca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1676 microversion: 2.1 time: 0.190630 Jul 21 22:36:12.892931 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 212/381] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:12 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:13.239011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7c38c47e-196a-457e-be1e-f99acf732b0b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:13.239745 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7c38c47e-196a-457e-be1e-f99acf732b0b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:13.246314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c38c47e-196a-457e-be1e-f99acf732b0b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.246757 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c38c47e-196a-457e-be1e-f99acf732b0b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.247578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c38c47e-196a-457e-be1e-f99acf732b0b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.248013 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c38c47e-196a-457e-be1e-f99acf732b0b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.288088 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-16e78d83-ccc1-4ab7-b8a6-20054dcb61ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:13.288678 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-16e78d83-ccc1-4ab7-b8a6-20054dcb61ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:13.294868 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-16e78d83-ccc1-4ab7-b8a6-20054dcb61ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.295355 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-16e78d83-ccc1-4ab7-b8a6-20054dcb61ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.296130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-16e78d83-ccc1-4ab7-b8a6-20054dcb61ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.297045 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-16e78d83-ccc1-4ab7-b8a6-20054dcb61ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.473059 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7c38c47e-196a-457e-be1e-f99acf732b0b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:13.485203 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7c38c47e-196a-457e-be1e-f99acf732b0b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1366 microversion: 2.1 time: 0.250036 Jul 21 22:36:13.486494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 170/382] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:13 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:13.492421 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-deb326fd-7593-4a8b-bcd8-0567bd894b62 req-f4a7821e-8d3c-48c4-9d5c-09344171eb05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1438311-05a8-4296-8299-b04c1702a3a3", "tag": "c05dbf3f-aef3-456a-8c56-37dd0824320f"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:13.499502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-16e78d83-ccc1-4ab7-b8a6-20054dcb61ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:13.510263 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-deb326fd-7593-4a8b-bcd8-0567bd894b62 req-f4a7821e-8d3c-48c4-9d5c-09344171eb05 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.510972 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-deb326fd-7593-4a8b-bcd8-0567bd894b62 req-f4a7821e-8d3c-48c4-9d5c-09344171eb05 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.516032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-16e78d83-ccc1-4ab7-b8a6-20054dcb61ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:13.517800 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-16e78d83-ccc1-4ab7-b8a6-20054dcb61ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:13.519706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-16e78d83-ccc1-4ab7-b8a6-20054dcb61ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.236069 Jul 21 22:36:13.520874 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 213/383] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:13 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:13.536834 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-deb326fd-7593-4a8b-bcd8-0567bd894b62 req-f4a7821e-8d3c-48c4-9d5c-09344171eb05 service nova] Creating event network-changed:c05dbf3f-aef3-456a-8c56-37dd0824320f for instance a1438311-05a8-4296-8299-b04c1702a3a3 on hv-cinder-85069 Jul 21 22:36:13.543183 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-deb326fd-7593-4a8b-bcd8-0567bd894b62 req-f4a7821e-8d3c-48c4-9d5c-09344171eb05 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054415 Jul 21 22:36:13.544079 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 171/384] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:13.912708 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-501c78e7-3198-418b-8665-1e7e4f3a4d04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:13.913731 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-501c78e7-3198-418b-8665-1e7e4f3a4d04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:13.924548 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-501c78e7-3198-418b-8665-1e7e4f3a4d04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.925374 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-501c78e7-3198-418b-8665-1e7e4f3a4d04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.926868 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-501c78e7-3198-418b-8665-1e7e4f3a4d04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.927693 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-501c78e7-3198-418b-8665-1e7e4f3a4d04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:14.109439 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-501c78e7-3198-418b-8665-1e7e4f3a4d04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:14.118929 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-501c78e7-3198-418b-8665-1e7e4f3a4d04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1676 microversion: 2.1 time: 0.212844 Jul 21 22:36:14.119600 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 214/385] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:13 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:14.505619 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-59f6dfea-5a39-4cb4-ba36-9fef42a3501a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:14.506663 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-59f6dfea-5a39-4cb4-ba36-9fef42a3501a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:14.514365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-59f6dfea-5a39-4cb4-ba36-9fef42a3501a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:14.514814 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-59f6dfea-5a39-4cb4-ba36-9fef42a3501a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:14.515637 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-59f6dfea-5a39-4cb4-ba36-9fef42a3501a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:14.516170 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-59f6dfea-5a39-4cb4-ba36-9fef42a3501a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:14.544970 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4ed9cb17-cbaa-4052-81b9-492dd60675c5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:14.546144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4ed9cb17-cbaa-4052-81b9-492dd60675c5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:14.561392 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ed9cb17-cbaa-4052-81b9-492dd60675c5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:14.562011 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ed9cb17-cbaa-4052-81b9-492dd60675c5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:14.563320 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ed9cb17-cbaa-4052-81b9-492dd60675c5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:14.563768 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ed9cb17-cbaa-4052-81b9-492dd60675c5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:14.748449 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-59f6dfea-5a39-4cb4-ba36-9fef42a3501a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:14.757503 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-59f6dfea-5a39-4cb4-ba36-9fef42a3501a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1366 microversion: 2.1 time: 0.256306 Jul 21 22:36:14.758099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 172/386] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:14 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:14.776988 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4ed9cb17-cbaa-4052-81b9-492dd60675c5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:14.787341 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4ed9cb17-cbaa-4052-81b9-492dd60675c5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:14.788869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4ed9cb17-cbaa-4052-81b9-492dd60675c5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:14.790056 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4ed9cb17-cbaa-4052-81b9-492dd60675c5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.252823 Jul 21 22:36:14.790639 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 215/387] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:14 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:15.137924 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7e9619ab-e936-4c1b-a05d-8476d1df7962 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:15.138696 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7e9619ab-e936-4c1b-a05d-8476d1df7962 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:15.146557 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7e9619ab-e936-4c1b-a05d-8476d1df7962 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:15.146995 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7e9619ab-e936-4c1b-a05d-8476d1df7962 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:15.147886 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7e9619ab-e936-4c1b-a05d-8476d1df7962 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:15.148314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7e9619ab-e936-4c1b-a05d-8476d1df7962 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:15.296806 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7e9619ab-e936-4c1b-a05d-8476d1df7962 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:15.304737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7e9619ab-e936-4c1b-a05d-8476d1df7962 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1676 microversion: 2.1 time: 0.171135 Jul 21 22:36:15.305332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 173/388] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:15 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:15.776959 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f80eb4ad-a17b-455a-9e1c-4562f7473e2b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:15.777580 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f80eb4ad-a17b-455a-9e1c-4562f7473e2b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:15.784212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f80eb4ad-a17b-455a-9e1c-4562f7473e2b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:15.784669 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f80eb4ad-a17b-455a-9e1c-4562f7473e2b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:15.785461 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f80eb4ad-a17b-455a-9e1c-4562f7473e2b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:15.785902 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f80eb4ad-a17b-455a-9e1c-4562f7473e2b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:15.809792 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-41781293-7e63-44b1-9929-0da719ba3aea tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:15.810464 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-41781293-7e63-44b1-9929-0da719ba3aea tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:15.818089 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-41781293-7e63-44b1-9929-0da719ba3aea tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:15.818530 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-41781293-7e63-44b1-9929-0da719ba3aea tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:15.819365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-41781293-7e63-44b1-9929-0da719ba3aea tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:15.819799 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-41781293-7e63-44b1-9929-0da719ba3aea tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:16.028796 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f80eb4ad-a17b-455a-9e1c-4562f7473e2b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:16.037512 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f80eb4ad-a17b-455a-9e1c-4562f7473e2b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1366 microversion: 2.1 time: 0.264570 Jul 21 22:36:16.038106 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 216/389] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:15 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:16.038732 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-41781293-7e63-44b1-9929-0da719ba3aea tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:16.048742 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-41781293-7e63-44b1-9929-0da719ba3aea tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:16.051016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-41781293-7e63-44b1-9929-0da719ba3aea tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:16.052571 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-41781293-7e63-44b1-9929-0da719ba3aea tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.246740 Jul 21 22:36:16.053169 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 174/390] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:15 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:16.324392 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f1ebf5a4-c8b3-49d6-b038-07c4687b4754 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:16.325209 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f1ebf5a4-c8b3-49d6-b038-07c4687b4754 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:16.333514 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f1ebf5a4-c8b3-49d6-b038-07c4687b4754 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:16.334016 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f1ebf5a4-c8b3-49d6-b038-07c4687b4754 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:16.334853 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f1ebf5a4-c8b3-49d6-b038-07c4687b4754 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:16.335534 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f1ebf5a4-c8b3-49d6-b038-07c4687b4754 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:16.494617 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f1ebf5a4-c8b3-49d6-b038-07c4687b4754 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:16.502645 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f1ebf5a4-c8b3-49d6-b038-07c4687b4754 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1676 microversion: 2.1 time: 0.183184 Jul 21 22:36:16.503339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 217/391] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:16 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:17.063298 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f1827f2c-b1d3-42b7-be15-1a0d504271b0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:17.063923 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f1827f2c-b1d3-42b7-be15-1a0d504271b0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:17.071554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1827f2c-b1d3-42b7-be15-1a0d504271b0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:17.071997 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1827f2c-b1d3-42b7-be15-1a0d504271b0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:17.072491 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-15cf4127-c0bd-49c3-a098-fcf5ce76d39d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:17.072965 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1827f2c-b1d3-42b7-be15-1a0d504271b0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:17.073512 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1827f2c-b1d3-42b7-be15-1a0d504271b0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:17.073637 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-15cf4127-c0bd-49c3-a098-fcf5ce76d39d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:17.080619 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-15cf4127-c0bd-49c3-a098-fcf5ce76d39d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:17.081864 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-15cf4127-c0bd-49c3-a098-fcf5ce76d39d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:17.083242 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-15cf4127-c0bd-49c3-a098-fcf5ce76d39d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:17.083758 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-15cf4127-c0bd-49c3-a098-fcf5ce76d39d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:17.087472 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:17.301745 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f1827f2c-b1d3-42b7-be15-1a0d504271b0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:17.312936 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-15cf4127-c0bd-49c3-a098-fcf5ce76d39d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:17.314182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f1827f2c-b1d3-42b7-be15-1a0d504271b0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1366 microversion: 2.1 time: 0.254746 Jul 21 22:36:17.314790 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 175/392] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:17 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:17.329674 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-15cf4127-c0bd-49c3-a098-fcf5ce76d39d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:17.332140 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-15cf4127-c0bd-49c3-a098-fcf5ce76d39d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:17.333523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-15cf4127-c0bd-49c3-a098-fcf5ce76d39d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.265365 Jul 21 22:36:17.334098 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 218/393] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:17 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:17.522693 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-38c579b1-e28a-49ed-9d9e-998f54b23fe6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:17.523336 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-38c579b1-e28a-49ed-9d9e-998f54b23fe6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:17.529696 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-38c579b1-e28a-49ed-9d9e-998f54b23fe6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:17.530137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-38c579b1-e28a-49ed-9d9e-998f54b23fe6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:17.530920 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-38c579b1-e28a-49ed-9d9e-998f54b23fe6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:17.531384 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-38c579b1-e28a-49ed-9d9e-998f54b23fe6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:17.705914 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-38c579b1-e28a-49ed-9d9e-998f54b23fe6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:17.714733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-38c579b1-e28a-49ed-9d9e-998f54b23fe6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1676 microversion: 2.1 time: 0.196947 Jul 21 22:36:17.715351 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 176/394] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:17 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:18.334222 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1676c4df-1356-44de-9110-6e6432aa9e14 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:18.334914 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1676c4df-1356-44de-9110-6e6432aa9e14 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:18.342066 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1676c4df-1356-44de-9110-6e6432aa9e14 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:18.342515 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1676c4df-1356-44de-9110-6e6432aa9e14 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:18.343354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1676c4df-1356-44de-9110-6e6432aa9e14 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:18.343797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1676c4df-1356-44de-9110-6e6432aa9e14 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:18.353183 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c16850be-9c4c-4ce1-ac92-5c7a7d37e894 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:18.353838 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c16850be-9c4c-4ce1-ac92-5c7a7d37e894 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:18.362891 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c16850be-9c4c-4ce1-ac92-5c7a7d37e894 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:18.363373 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c16850be-9c4c-4ce1-ac92-5c7a7d37e894 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:18.364182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c16850be-9c4c-4ce1-ac92-5c7a7d37e894 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:18.364616 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c16850be-9c4c-4ce1-ac92-5c7a7d37e894 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:18.601686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1676c4df-1356-44de-9110-6e6432aa9e14 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:18.604780 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c16850be-9c4c-4ce1-ac92-5c7a7d37e894 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:18.617779 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1676c4df-1356-44de-9110-6e6432aa9e14 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1366 microversion: 2.1 time: 0.288713 Jul 21 22:36:18.618957 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 219/395] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:18 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:18.622219 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c16850be-9c4c-4ce1-ac92-5c7a7d37e894 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:18.625041 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c16850be-9c4c-4ce1-ac92-5c7a7d37e894 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:18.626993 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c16850be-9c4c-4ce1-ac92-5c7a7d37e894 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.277829 Jul 21 22:36:18.628239 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 177/396] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:18 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:18.736066 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c4ef102e-22e5-43cb-b5de-b194cc4eb726 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:18.737093 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c4ef102e-22e5-43cb-b5de-b194cc4eb726 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:18.747048 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c4ef102e-22e5-43cb-b5de-b194cc4eb726 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:18.747843 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c4ef102e-22e5-43cb-b5de-b194cc4eb726 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:18.749074 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c4ef102e-22e5-43cb-b5de-b194cc4eb726 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:18.749561 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c4ef102e-22e5-43cb-b5de-b194cc4eb726 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:18.938966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c4ef102e-22e5-43cb-b5de-b194cc4eb726 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:18.953224 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c4ef102e-22e5-43cb-b5de-b194cc4eb726 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1676 microversion: 2.1 time: 0.219949 Jul 21 22:36:18.953224 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 220/397] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:18 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:19.075377 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2094f8d7-64a0-48a4-ad65-964bb12aad2b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:19.076283 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2094f8d7-64a0-48a4-ad65-964bb12aad2b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:19.084096 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2094f8d7-64a0-48a4-ad65-964bb12aad2b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.084729 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2094f8d7-64a0-48a4-ad65-964bb12aad2b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:19.085578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2094f8d7-64a0-48a4-ad65-964bb12aad2b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.086028 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2094f8d7-64a0-48a4-ad65-964bb12aad2b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:19.248455 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-2094f8d7-64a0-48a4-ad65-964bb12aad2b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:19.257782 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2094f8d7-64a0-48a4-ad65-964bb12aad2b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1594 microversion: 2.1 time: 0.189626 Jul 21 22:36:19.258401 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 178/398] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:19 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1594 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:19.637992 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1d226a35-1493-4abd-9cf9-0398ab51bdb6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:19.638909 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1d226a35-1493-4abd-9cf9-0398ab51bdb6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:19.646239 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1d226a35-1493-4abd-9cf9-0398ab51bdb6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.646985 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1d226a35-1493-4abd-9cf9-0398ab51bdb6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:19.647967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1d226a35-1493-4abd-9cf9-0398ab51bdb6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.648563 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1d226a35-1493-4abd-9cf9-0398ab51bdb6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:19.654470 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2b14cf4d-902d-4090-9aa4-ecb0180e3bcb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:19.656842 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2b14cf4d-902d-4090-9aa4-ecb0180e3bcb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:19.678472 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2b14cf4d-902d-4090-9aa4-ecb0180e3bcb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.680321 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2b14cf4d-902d-4090-9aa4-ecb0180e3bcb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:19.682300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2b14cf4d-902d-4090-9aa4-ecb0180e3bcb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.683422 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2b14cf4d-902d-4090-9aa4-ecb0180e3bcb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.032468 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1d226a35-1493-4abd-9cf9-0398ab51bdb6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:20.043981 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1d226a35-1493-4abd-9cf9-0398ab51bdb6 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1366 microversion: 2.1 time: 0.409873 Jul 21 22:36:20.045094 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 221/399] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:19 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:20.051342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-a26590dc-5d78-4af8-b322-1614eebddf1a req-3339616c-fe2a-4292-bc3f-dec14c8974da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1438311-05a8-4296-8299-b04c1702a3a3", "name": "network-vif-plugged", "status": "completed", "tag": "c05dbf3f-aef3-456a-8c56-37dd0824320f"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:20.051978 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-2b14cf4d-902d-4090-9aa4-ecb0180e3bcb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:20.063590 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-a26590dc-5d78-4af8-b322-1614eebddf1a req-3339616c-fe2a-4292-bc3f-dec14c8974da service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.064352 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-a26590dc-5d78-4af8-b322-1614eebddf1a req-3339616c-fe2a-4292-bc3f-dec14c8974da service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.069998 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-2b14cf4d-902d-4090-9aa4-ecb0180e3bcb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:20.073833 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-2b14cf4d-902d-4090-9aa4-ecb0180e3bcb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:20.076280 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2b14cf4d-902d-4090-9aa4-ecb0180e3bcb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.430681 Jul 21 22:36:20.077274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 179/400] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:19 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:20.077274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-65581e2f-15dc-49c7-8bcb-7c643b5b1bfc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:20.088174 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-65581e2f-15dc-49c7-8bcb-7c643b5b1bfc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:20.090143 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-a26590dc-5d78-4af8-b322-1614eebddf1a req-3339616c-fe2a-4292-bc3f-dec14c8974da service nova] Creating event network-vif-plugged:c05dbf3f-aef3-456a-8c56-37dd0824320f for instance a1438311-05a8-4296-8299-b04c1702a3a3 on hv-cinder-85069 Jul 21 22:36:20.096277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-a26590dc-5d78-4af8-b322-1614eebddf1a req-3339616c-fe2a-4292-bc3f-dec14c8974da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049144 Jul 21 22:36:20.097663 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 222/401] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:20.099651 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-65581e2f-15dc-49c7-8bcb-7c643b5b1bfc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.100445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-65581e2f-15dc-49c7-8bcb-7c643b5b1bfc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.101839 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-65581e2f-15dc-49c7-8bcb-7c643b5b1bfc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.102971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-65581e2f-15dc-49c7-8bcb-7c643b5b1bfc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.377433 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-65581e2f-15dc-49c7-8bcb-7c643b5b1bfc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:20.387779 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-65581e2f-15dc-49c7-8bcb-7c643b5b1bfc tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1676 microversion: 2.1 time: 0.308777 Jul 21 22:36:20.388793 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 180/402] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:20 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1676 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:21.068168 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9684ed24-9cd8-4e34-90d8-dd4959109612 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:21.070296 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-9684ed24-9cd8-4e34-90d8-dd4959109612 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:21.081137 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9684ed24-9cd8-4e34-90d8-dd4959109612 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.082211 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9684ed24-9cd8-4e34-90d8-dd4959109612 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:21.083655 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9684ed24-9cd8-4e34-90d8-dd4959109612 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.084420 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9684ed24-9cd8-4e34-90d8-dd4959109612 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:21.098163 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4cee0770-9675-40b2-ba90-d193962e8ea2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:21.099425 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4cee0770-9675-40b2-ba90-d193962e8ea2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:21.107928 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4cee0770-9675-40b2-ba90-d193962e8ea2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.109019 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4cee0770-9675-40b2-ba90-d193962e8ea2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:21.110255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4cee0770-9675-40b2-ba90-d193962e8ea2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.110981 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4cee0770-9675-40b2-ba90-d193962e8ea2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:21.349608 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-9684ed24-9cd8-4e34-90d8-dd4959109612 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:21.353867 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4cee0770-9675-40b2-ba90-d193962e8ea2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:21.358613 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-9684ed24-9cd8-4e34-90d8-dd4959109612 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1366 microversion: 2.1 time: 0.299458 Jul 21 22:36:21.359497 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 223/403] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:21 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:21.364283 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4cee0770-9675-40b2-ba90-d193962e8ea2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:21.365840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4cee0770-9675-40b2-ba90-d193962e8ea2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:21.367106 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4cee0770-9675-40b2-ba90-d193962e8ea2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.274692 Jul 21 22:36:21.379999 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 181/404] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:21 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:21.411674 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-840e89d1-810b-4135-8709-3bd9638432e0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:21.413289 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-840e89d1-810b-4135-8709-3bd9638432e0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:21.427334 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-840e89d1-810b-4135-8709-3bd9638432e0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.428383 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-840e89d1-810b-4135-8709-3bd9638432e0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:21.429998 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-840e89d1-810b-4135-8709-3bd9638432e0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.430984 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-840e89d1-810b-4135-8709-3bd9638432e0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:21.648852 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-840e89d1-810b-4135-8709-3bd9638432e0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:21.656886 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-840e89d1-810b-4135-8709-3bd9638432e0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1676 microversion: 2.1 time: 0.252672 Jul 21 22:36:21.657478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 224/405] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:21 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:21.769472 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-878374c1-d5bf-4976-9f69-4f34686a5d1f req-3c83d4ce-a463-4902-8490-e034d3af8952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c323b31-2485-44f9-87e9-f2c4e8677f48", "tag": "b7065a68-717c-4122-b368-f36d2417f2f0"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:21.779019 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-878374c1-d5bf-4976-9f69-4f34686a5d1f req-3c83d4ce-a463-4902-8490-e034d3af8952 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.780457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-878374c1-d5bf-4976-9f69-4f34686a5d1f req-3c83d4ce-a463-4902-8490-e034d3af8952 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:21.795947 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-878374c1-d5bf-4976-9f69-4f34686a5d1f req-3c83d4ce-a463-4902-8490-e034d3af8952 service nova] Creating event network-changed:b7065a68-717c-4122-b368-f36d2417f2f0 for instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 on hv-cinder-85069 Jul 21 22:36:21.803986 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-878374c1-d5bf-4976-9f69-4f34686a5d1f req-3c83d4ce-a463-4902-8490-e034d3af8952 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038722 Jul 21 22:36:21.804761 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 182/406] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:22.137295 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-6bc1e549-f3a8-4f13-865b-149179b7b8df req-c1d42e74-fe0b-41b5-8646-caada06c67bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdafcf28-8b2d-4692-ba35-cd63d2c32de7", "name": "network-vif-plugged", "status": "completed", "tag": "7beeb33e-b868-478b-961b-f1fcce969c8c"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:22.161858 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-6bc1e549-f3a8-4f13-865b-149179b7b8df req-c1d42e74-fe0b-41b5-8646-caada06c67bc service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.165789 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-6bc1e549-f3a8-4f13-865b-149179b7b8df req-c1d42e74-fe0b-41b5-8646-caada06c67bc service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.181332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-6bc1e549-f3a8-4f13-865b-149179b7b8df req-c1d42e74-fe0b-41b5-8646-caada06c67bc service nova] Creating event network-vif-plugged:7beeb33e-b868-478b-961b-f1fcce969c8c for instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 on hv-cinder-85069 Jul 21 22:36:22.191204 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-6bc1e549-f3a8-4f13-865b-149179b7b8df req-c1d42e74-fe0b-41b5-8646-caada06c67bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056086 Jul 21 22:36:22.192693 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 225/407] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:22.404366 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cf7a765d-32ce-4a8f-b60a-1008ddb4ace1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:22.406135 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-84becd95-ce29-4bcd-93b8-0686bdab278b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:22.407590 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-cf7a765d-32ce-4a8f-b60a-1008ddb4ace1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:22.408232 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-84becd95-ce29-4bcd-93b8-0686bdab278b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:22.423989 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cf7a765d-32ce-4a8f-b60a-1008ddb4ace1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.428854 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-84becd95-ce29-4bcd-93b8-0686bdab278b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.429557 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cf7a765d-32ce-4a8f-b60a-1008ddb4ace1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.430521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cf7a765d-32ce-4a8f-b60a-1008ddb4ace1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.431166 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-84becd95-ce29-4bcd-93b8-0686bdab278b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.432196 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-84becd95-ce29-4bcd-93b8-0686bdab278b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.432804 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cf7a765d-32ce-4a8f-b60a-1008ddb4ace1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.436123 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-84becd95-ce29-4bcd-93b8-0686bdab278b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.724266 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-84becd95-ce29-4bcd-93b8-0686bdab278b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:22.731424 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cf7a765d-32ce-4a8f-b60a-1008ddb4ace1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:22.733205 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-84becd95-ce29-4bcd-93b8-0686bdab278b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1555 microversion: 2.1 time: 0.350302 Jul 21 22:36:22.746305 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 183/408] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:22 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1555 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:22.750818 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cf7a765d-32ce-4a8f-b60a-1008ddb4ace1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:22.752296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a0a73e0e-7c1e-4789-9f6c-daa1263cb8d6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:22.753866 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a0a73e0e-7c1e-4789-9f6c-daa1263cb8d6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:22.754703 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cf7a765d-32ce-4a8f-b60a-1008ddb4ace1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:22.760568 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-cf7a765d-32ce-4a8f-b60a-1008ddb4ace1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.364226 Jul 21 22:36:22.761532 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a0a73e0e-7c1e-4789-9f6c-daa1263cb8d6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.762220 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a0a73e0e-7c1e-4789-9f6c-daa1263cb8d6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.763444 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a0a73e0e-7c1e-4789-9f6c-daa1263cb8d6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.764138 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a0a73e0e-7c1e-4789-9f6c-daa1263cb8d6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.766266 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 226/409] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:22 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:22.767958 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:22.790575 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ee2ee3f2-6c0c-4b9f-b5bd-9d6163b3ef06 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:22.792129 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ee2ee3f2-6c0c-4b9f-b5bd-9d6163b3ef06 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:22.805953 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee2ee3f2-6c0c-4b9f-b5bd-9d6163b3ef06 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.806570 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee2ee3f2-6c0c-4b9f-b5bd-9d6163b3ef06 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.808307 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee2ee3f2-6c0c-4b9f-b5bd-9d6163b3ef06 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.809114 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee2ee3f2-6c0c-4b9f-b5bd-9d6163b3ef06 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.012787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ee2ee3f2-6c0c-4b9f-b5bd-9d6163b3ef06 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.240997 Jul 21 22:36:23.015211 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 227/410] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 22:36:22 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3/os-interface => generated 284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:23.130351 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a0a73e0e-7c1e-4789-9f6c-daa1263cb8d6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:23.144268 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a0a73e0e-7c1e-4789-9f6c-daa1263cb8d6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1676 microversion: 2.1 time: 0.395938 Jul 21 22:36:23.147170 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 184/411] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:22 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1676 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:23.427421 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-50c31ee7-8fee-47ba-a8cb-0cc73b693c37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2093010038"}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:23.428296 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-50c31ee7-8fee-47ba-a8cb-0cc73b693c37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:23.439912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50c31ee7-8fee-47ba-a8cb-0cc73b693c37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.440808 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50c31ee7-8fee-47ba-a8cb-0cc73b693c37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.442573 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50c31ee7-8fee-47ba-a8cb-0cc73b693c37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.443412 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50c31ee7-8fee-47ba-a8cb-0cc73b693c37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.641841 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.network.security_group_api [None req-50c31ee7-8fee-47ba-a8cb-0cc73b693c37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Adding security group c283507e-3ce2-4081-a122-88cafa5766e5 to port b7065a68-717c-4122-b368-f36d2417f2f0 Jul 21 22:36:23.797157 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-640f7017-337e-48ea-a5a6-5af3dddb318e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:23.799591 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-640f7017-337e-48ea-a5a6-5af3dddb318e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:23.824054 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-640f7017-337e-48ea-a5a6-5af3dddb318e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.826666 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-640f7017-337e-48ea-a5a6-5af3dddb318e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.833642 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-640f7017-337e-48ea-a5a6-5af3dddb318e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.836118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-640f7017-337e-48ea-a5a6-5af3dddb318e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.100105 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-640f7017-337e-48ea-a5a6-5af3dddb318e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:24.116634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-640f7017-337e-48ea-a5a6-5af3dddb318e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:24.120232 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-640f7017-337e-48ea-a5a6-5af3dddb318e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:24.121883 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-640f7017-337e-48ea-a5a6-5af3dddb318e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.332051 Jul 21 22:36:24.123345 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 185/412] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:23 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:24.178172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-20e38dcb-3a2e-4321-a07b-b38c2585e9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:24.178862 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-20e38dcb-3a2e-4321-a07b-b38c2585e9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:24.185903 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-20e38dcb-3a2e-4321-a07b-b38c2585e9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.186379 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-20e38dcb-3a2e-4321-a07b-b38c2585e9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.187159 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-20e38dcb-3a2e-4321-a07b-b38c2585e9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.187596 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-20e38dcb-3a2e-4321-a07b-b38c2585e9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.343562 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-50c31ee7-8fee-47ba-a8cb-0cc73b693c37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "POST /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/action" status: 202 len: 0 microversion: 2.1 time: 0.923001 Jul 21 22:36:24.344184 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 228/413] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:36:23 2022] POST /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/action => generated 0 bytes in 925 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:36:24.355002 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-13a7f022-17d3-4c4a-9ff9-7ef21ae59c4c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:24.355913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-13a7f022-17d3-4c4a-9ff9-7ef21ae59c4c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:24.367533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-13a7f022-17d3-4c4a-9ff9-7ef21ae59c4c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.370574 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-13a7f022-17d3-4c4a-9ff9-7ef21ae59c4c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.375431 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-13a7f022-17d3-4c4a-9ff9-7ef21ae59c4c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.376137 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-13a7f022-17d3-4c4a-9ff9-7ef21ae59c4c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.636381 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-20e38dcb-3a2e-4321-a07b-b38c2585e9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:24.656422 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-20e38dcb-3a2e-4321-a07b-b38c2585e9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1653 microversion: 2.1 time: 0.483504 Jul 21 22:36:24.680504 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 186/414] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:24 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1653 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:24.687755 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-ab877bb6-d9de-4ff8-9272-92a7f4ab8f64 req-a2efcf3a-f231-4998-b15a-1ca3fcdd905f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c323b31-2485-44f9-87e9-f2c4e8677f48", "tag": "b7065a68-717c-4122-b368-f36d2417f2f0"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:24.700214 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-ab877bb6-d9de-4ff8-9272-92a7f4ab8f64 req-a2efcf3a-f231-4998-b15a-1ca3fcdd905f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.701021 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-ab877bb6-d9de-4ff8-9272-92a7f4ab8f64 req-a2efcf3a-f231-4998-b15a-1ca3fcdd905f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.720080 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-ab877bb6-d9de-4ff8-9272-92a7f4ab8f64 req-a2efcf3a-f231-4998-b15a-1ca3fcdd905f service nova] Creating event network-changed:b7065a68-717c-4122-b368-f36d2417f2f0 for instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 on hv-cinder-85069 Jul 21 22:36:24.728025 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-ab877bb6-d9de-4ff8-9272-92a7f4ab8f64 req-a2efcf3a-f231-4998-b15a-1ca3fcdd905f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045741 Jul 21 22:36:24.729377 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 187/415] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:24.736577 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0999224a-0057-47d7-83b1-c8005cef7d8e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:24.747205 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0999224a-0057-47d7-83b1-c8005cef7d8e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.748090 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0999224a-0057-47d7-83b1-c8005cef7d8e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.771433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-13a7f022-17d3-4c4a-9ff9-7ef21ae59c4c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:24.781118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0999224a-0057-47d7-83b1-c8005cef7d8e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Going to try to start instance {{(pid=124497) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 22:36:24.794597 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-13a7f022-17d3-4c4a-9ff9-7ef21ae59c4c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1641 microversion: 2.1 time: 0.443209 Jul 21 22:36:24.796570 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 229/416] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:24 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1641 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:24.867452 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0999224a-0057-47d7-83b1-c8005cef7d8e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "POST /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/action" status: 202 len: 0 microversion: 2.1 time: 0.136267 Jul 21 22:36:24.873093 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 188/417] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:36:24 2022] POST /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:36:24.882950 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b64c7387-a9e6-498a-9eaf-06615c52fe4f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:24.884428 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b64c7387-a9e6-498a-9eaf-06615c52fe4f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:24.896300 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b64c7387-a9e6-498a-9eaf-06615c52fe4f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.896908 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b64c7387-a9e6-498a-9eaf-06615c52fe4f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.897819 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b64c7387-a9e6-498a-9eaf-06615c52fe4f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.898404 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b64c7387-a9e6-498a-9eaf-06615c52fe4f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.146679 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-513f4ab2-b52d-42cf-92a4-5d66adc985e5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:25.147452 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-513f4ab2-b52d-42cf-92a4-5d66adc985e5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:25.156195 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-513f4ab2-b52d-42cf-92a4-5d66adc985e5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:25.156658 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-513f4ab2-b52d-42cf-92a4-5d66adc985e5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.157498 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-513f4ab2-b52d-42cf-92a4-5d66adc985e5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:25.158163 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-513f4ab2-b52d-42cf-92a4-5d66adc985e5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.445312 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b64c7387-a9e6-498a-9eaf-06615c52fe4f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:25.454310 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b64c7387-a9e6-498a-9eaf-06615c52fe4f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1662 microversion: 2.1 time: 0.579595 Jul 21 22:36:25.455541 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 230/418] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:24 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1662 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:25.520783 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-513f4ab2-b52d-42cf-92a4-5d66adc985e5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:25.530383 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-513f4ab2-b52d-42cf-92a4-5d66adc985e5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:25.532251 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-513f4ab2-b52d-42cf-92a4-5d66adc985e5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:25.533464 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-513f4ab2-b52d-42cf-92a4-5d66adc985e5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.395653 Jul 21 22:36:25.534241 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 189/419] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:25 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:25.710886 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-42fdde18-b51d-49f9-93d9-35eb05ab20c5 req-2f21a857-cc96-407e-b1cd-898049c48b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1438311-05a8-4296-8299-b04c1702a3a3", "tag": "c05dbf3f-aef3-456a-8c56-37dd0824320f"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:25.719954 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-42fdde18-b51d-49f9-93d9-35eb05ab20c5 req-2f21a857-cc96-407e-b1cd-898049c48b1d service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:25.720495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-42fdde18-b51d-49f9-93d9-35eb05ab20c5 req-2f21a857-cc96-407e-b1cd-898049c48b1d service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.733188 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-42fdde18-b51d-49f9-93d9-35eb05ab20c5 req-2f21a857-cc96-407e-b1cd-898049c48b1d service nova] Creating event network-changed:c05dbf3f-aef3-456a-8c56-37dd0824320f for instance a1438311-05a8-4296-8299-b04c1702a3a3 on hv-cinder-85069 Jul 21 22:36:25.739444 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-42fdde18-b51d-49f9-93d9-35eb05ab20c5 req-2f21a857-cc96-407e-b1cd-898049c48b1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033389 Jul 21 22:36:25.740069 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 231/420] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:36:26.500167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0f70e5ec-52d2-495c-823c-712d5f92a9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:26.505259 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0f70e5ec-52d2-495c-823c-712d5f92a9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:26.529331 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f70e5ec-52d2-495c-823c-712d5f92a9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:26.532314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f70e5ec-52d2-495c-823c-712d5f92a9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:26.534937 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f70e5ec-52d2-495c-823c-712d5f92a9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:26.536018 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f70e5ec-52d2-495c-823c-712d5f92a9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:26.568085 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6e8d6509-c0c1-4125-9fa9-a1ae24551b47 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:26.569673 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6e8d6509-c0c1-4125-9fa9-a1ae24551b47 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:26.584269 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6e8d6509-c0c1-4125-9fa9-a1ae24551b47 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:26.585619 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6e8d6509-c0c1-4125-9fa9-a1ae24551b47 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:26.587493 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6e8d6509-c0c1-4125-9fa9-a1ae24551b47 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:26.588757 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6e8d6509-c0c1-4125-9fa9-a1ae24551b47 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:26.921149 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6e8d6509-c0c1-4125-9fa9-a1ae24551b47 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:26.950368 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6e8d6509-c0c1-4125-9fa9-a1ae24551b47 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:26.954784 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6e8d6509-c0c1-4125-9fa9-a1ae24551b47 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:26.958587 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6e8d6509-c0c1-4125-9fa9-a1ae24551b47 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1808 microversion: 2.20 time: 0.408949 Jul 21 22:36:26.960345 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 232/421] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:26 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1808 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:26.990399 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-0f70e5ec-52d2-495c-823c-712d5f92a9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:27.004928 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0f70e5ec-52d2-495c-823c-712d5f92a9e6 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1662 microversion: 2.1 time: 0.525820 Jul 21 22:36:27.019481 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 190/422] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:26 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1662 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:27.979156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-65305f57-ae43-41e3-b0c5-3598e620e086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:27.979813 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-65305f57-ae43-41e3-b0c5-3598e620e086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:27.981749 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=94 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:27.989734 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65305f57-ae43-41e3-b0c5-3598e620e086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:27.990188 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65305f57-ae43-41e3-b0c5-3598e620e086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:27.990991 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65305f57-ae43-41e3-b0c5-3598e620e086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:27.991463 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65305f57-ae43-41e3-b0c5-3598e620e086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:28.040450 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e666a627-e913-4472-8ac9-f8af4a5d07f4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:28.047394 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e666a627-e913-4472-8ac9-f8af4a5d07f4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:28.061438 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e666a627-e913-4472-8ac9-f8af4a5d07f4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.062726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e666a627-e913-4472-8ac9-f8af4a5d07f4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:28.064510 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e666a627-e913-4472-8ac9-f8af4a5d07f4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.066176 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e666a627-e913-4472-8ac9-f8af4a5d07f4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:28.216350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-65305f57-ae43-41e3-b0c5-3598e620e086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:28.235270 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-65305f57-ae43-41e3-b0c5-3598e620e086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:28.239909 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-65305f57-ae43-41e3-b0c5-3598e620e086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:28.241818 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-65305f57-ae43-41e3-b0c5-3598e620e086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1795 microversion: 2.20 time: 0.266760 Jul 21 22:36:28.242569 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 233/423] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:27 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1795 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:28.282385 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e666a627-e913-4472-8ac9-f8af4a5d07f4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:28.291189 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e666a627-e913-4472-8ac9-f8af4a5d07f4 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1662 microversion: 2.1 time: 0.254407 Jul 21 22:36:28.291813 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 191/424] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:28 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1662 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:29.309713 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c8b2b57c-05e1-4cad-ab26-803f5b8a1f1d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:29.310468 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c8b2b57c-05e1-4cad-ab26-803f5b8a1f1d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:29.317690 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c8b2b57c-05e1-4cad-ab26-803f5b8a1f1d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:29.318135 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c8b2b57c-05e1-4cad-ab26-803f5b8a1f1d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:29.318927 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c8b2b57c-05e1-4cad-ab26-803f5b8a1f1d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:29.319419 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c8b2b57c-05e1-4cad-ab26-803f5b8a1f1d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:29.464671 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c8b2b57c-05e1-4cad-ab26-803f5b8a1f1d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:29.472676 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c8b2b57c-05e1-4cad-ab26-803f5b8a1f1d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1666 microversion: 2.1 time: 0.167470 Jul 21 22:36:29.473394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 234/425] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:29 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1666 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:45.442786 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b7465543-fedd-4326-8867-5b5d2c622446 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:45.444030 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b7465543-fedd-4326-8867-5b5d2c622446 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:45.447443 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=52 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:45.448353 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:45.457176 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b7465543-fedd-4326-8867-5b5d2c622446 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:45.457637 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b7465543-fedd-4326-8867-5b5d2c622446 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:45.458461 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b7465543-fedd-4326-8867-5b5d2c622446 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:45.458906 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b7465543-fedd-4326-8867-5b5d2c622446 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:45.551697 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b7465543-fedd-4326-8867-5b5d2c622446 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "POST /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/action" status: 202 len: 0 microversion: 2.1 time: 0.113707 Jul 21 22:36:45.552444 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 192/426] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:36:45 2022] POST /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:36:45.561436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-bfd55414-7afe-469c-bf1a-d2d7fe9bc538 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:45.562335 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-bfd55414-7afe-469c-bf1a-d2d7fe9bc538 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:45.565211 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=3 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:45.566001 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=85 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:45.573569 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bfd55414-7afe-469c-bf1a-d2d7fe9bc538 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:45.574040 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bfd55414-7afe-469c-bf1a-d2d7fe9bc538 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:45.574859 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bfd55414-7afe-469c-bf1a-d2d7fe9bc538 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:45.575332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bfd55414-7afe-469c-bf1a-d2d7fe9bc538 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:45.588316 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-536ed6a5-9975-4338-aeb7-3b666e4ab3d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f00bc401-e488-458b-9825-157831fb1bea"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:45.590502 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-536ed6a5-9975-4338-aeb7-3b666e4ab3d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:45.601402 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-536ed6a5-9975-4338-aeb7-3b666e4ab3d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:45.602111 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-536ed6a5-9975-4338-aeb7-3b666e4ab3d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:45.603283 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-536ed6a5-9975-4338-aeb7-3b666e4ab3d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:45.603939 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-536ed6a5-9975-4338-aeb7-3b666e4ab3d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:45.810897 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-bfd55414-7afe-469c-bf1a-d2d7fe9bc538 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:45.826637 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-bfd55414-7afe-469c-bf1a-d2d7fe9bc538 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1752 microversion: 2.1 time: 0.268822 Jul 21 22:36:45.828667 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 235/427] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:45 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1752 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:46.015649 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-536ed6a5-9975-4338-aeb7-3b666e4ab3d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "POST /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.434769 Jul 21 22:36:46.024545 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 193/428] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:36:45 2022] POST /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:36:46.848566 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6a5bad84-7ac5-4fdf-ba8b-ea1bdb61fa3d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:46.849254 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6a5bad84-7ac5-4fdf-ba8b-ea1bdb61fa3d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:46.856555 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6a5bad84-7ac5-4fdf-ba8b-ea1bdb61fa3d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:46.857082 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6a5bad84-7ac5-4fdf-ba8b-ea1bdb61fa3d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:46.858035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6a5bad84-7ac5-4fdf-ba8b-ea1bdb61fa3d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:46.858574 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6a5bad84-7ac5-4fdf-ba8b-ea1bdb61fa3d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:47.027998 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6a5bad84-7ac5-4fdf-ba8b-ea1bdb61fa3d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:47.042173 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6a5bad84-7ac5-4fdf-ba8b-ea1bdb61fa3d tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.198676 Jul 21 22:36:47.043213 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 236/429] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:46 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:48.062242 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7cc74a92-c223-443e-b15c-0de89002482e tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:48.065946 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7cc74a92-c223-443e-b15c-0de89002482e tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:48.075726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7cc74a92-c223-443e-b15c-0de89002482e tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:48.076218 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7cc74a92-c223-443e-b15c-0de89002482e tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:48.077135 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7cc74a92-c223-443e-b15c-0de89002482e tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:48.077578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7cc74a92-c223-443e-b15c-0de89002482e tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:48.249907 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7cc74a92-c223-443e-b15c-0de89002482e tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:48.259161 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7cc74a92-c223-443e-b15c-0de89002482e tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.201931 Jul 21 22:36:48.259749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 194/430] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:48 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:49.277306 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c23cf204-753f-4d0c-a215-a51ea57e5533 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:49.278592 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c23cf204-753f-4d0c-a215-a51ea57e5533 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:49.285583 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c23cf204-753f-4d0c-a215-a51ea57e5533 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:49.286351 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c23cf204-753f-4d0c-a215-a51ea57e5533 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:49.287373 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c23cf204-753f-4d0c-a215-a51ea57e5533 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:49.287973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c23cf204-753f-4d0c-a215-a51ea57e5533 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:49.488237 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c23cf204-753f-4d0c-a215-a51ea57e5533 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:49.497268 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c23cf204-753f-4d0c-a215-a51ea57e5533 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.223783 Jul 21 22:36:49.497888 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 237/431] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:49 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:50.515741 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a19f86bf-6e57-4113-8844-98a306074c06 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:50.516431 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a19f86bf-6e57-4113-8844-98a306074c06 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:50.524768 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a19f86bf-6e57-4113-8844-98a306074c06 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:50.525220 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a19f86bf-6e57-4113-8844-98a306074c06 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:50.526004 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a19f86bf-6e57-4113-8844-98a306074c06 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:50.526451 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a19f86bf-6e57-4113-8844-98a306074c06 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:50.691703 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a19f86bf-6e57-4113-8844-98a306074c06 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:50.700513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a19f86bf-6e57-4113-8844-98a306074c06 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.188615 Jul 21 22:36:50.701114 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 195/432] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:50 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:51.718605 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c93dd788-571f-41ab-bcda-3a427397f6a6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:51.719232 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c93dd788-571f-41ab-bcda-3a427397f6a6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:51.725726 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c93dd788-571f-41ab-bcda-3a427397f6a6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:51.726176 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c93dd788-571f-41ab-bcda-3a427397f6a6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:51.726960 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c93dd788-571f-41ab-bcda-3a427397f6a6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:51.727423 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c93dd788-571f-41ab-bcda-3a427397f6a6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:51.889624 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c93dd788-571f-41ab-bcda-3a427397f6a6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:51.898599 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c93dd788-571f-41ab-bcda-3a427397f6a6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.184125 Jul 21 22:36:51.899198 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 238/433] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:51 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:52.921049 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a4c0d001-0f22-4fb9-8d0a-f9c2d9b383a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:52.921751 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a4c0d001-0f22-4fb9-8d0a-f9c2d9b383a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:52.929738 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a4c0d001-0f22-4fb9-8d0a-f9c2d9b383a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:52.930220 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a4c0d001-0f22-4fb9-8d0a-f9c2d9b383a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:52.931013 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a4c0d001-0f22-4fb9-8d0a-f9c2d9b383a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:52.931490 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a4c0d001-0f22-4fb9-8d0a-f9c2d9b383a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:53.116511 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a4c0d001-0f22-4fb9-8d0a-f9c2d9b383a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:53.124974 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a4c0d001-0f22-4fb9-8d0a-f9c2d9b383a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.208160 Jul 21 22:36:53.125563 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 196/434] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:52 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:53.637744 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b0780621-0515-4fb9-b39f-17acf16816c0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:53.638749 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b0780621-0515-4fb9-b39f-17acf16816c0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:53.646672 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b0780621-0515-4fb9-b39f-17acf16816c0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:53.647211 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b0780621-0515-4fb9-b39f-17acf16816c0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:53.648925 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b0780621-0515-4fb9-b39f-17acf16816c0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:53.648925 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b0780621-0515-4fb9-b39f-17acf16816c0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:53.675240 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-b0780621-0515-4fb9-b39f-17acf16816c0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lazy-loading 'flavor' on Instance uuid c214c984-d0d9-4920-882c-6b481647edc5 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:36:53.815192 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b0780621-0515-4fb9-b39f-17acf16816c0 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "POST /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/action" status: 200 len: 32 microversion: 2.1 time: 0.180432 Jul 21 22:36:53.815720 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 239/435] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:36:53 2022] POST /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 22:36:53.826332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-70a4a915-6def-4d3c-a9c7-c2c0365b3499 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:53.827115 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-70a4a915-6def-4d3c-a9c7-c2c0365b3499 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:53.835457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-70a4a915-6def-4d3c-a9c7-c2c0365b3499 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:53.836137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-70a4a915-6def-4d3c-a9c7-c2c0365b3499 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:53.837325 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-70a4a915-6def-4d3c-a9c7-c2c0365b3499 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:53.838056 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-70a4a915-6def-4d3c-a9c7-c2c0365b3499 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:53.994649 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-70a4a915-6def-4d3c-a9c7-c2c0365b3499 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:54.004351 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-70a4a915-6def-4d3c-a9c7-c2c0365b3499 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.182554 Jul 21 22:36:54.004958 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 197/436] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:53 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:54.144144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f0b5fb42-fbe3-480a-9f79-cf9cdaef95c5 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:54.144851 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f0b5fb42-fbe3-480a-9f79-cf9cdaef95c5 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:54.151044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f0b5fb42-fbe3-480a-9f79-cf9cdaef95c5 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:54.151581 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f0b5fb42-fbe3-480a-9f79-cf9cdaef95c5 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:54.152356 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f0b5fb42-fbe3-480a-9f79-cf9cdaef95c5 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:54.152883 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f0b5fb42-fbe3-480a-9f79-cf9cdaef95c5 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:54.322709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f0b5fb42-fbe3-480a-9f79-cf9cdaef95c5 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:54.332361 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f0b5fb42-fbe3-480a-9f79-cf9cdaef95c5 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.192754 Jul 21 22:36:54.333064 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 240/437] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:54 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:55.022985 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-774dd8da-3b0e-4cd0-8ab9-d4e1d5c86f91 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:55.023648 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-774dd8da-3b0e-4cd0-8ab9-d4e1d5c86f91 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:55.031086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-774dd8da-3b0e-4cd0-8ab9-d4e1d5c86f91 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:55.031580 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-774dd8da-3b0e-4cd0-8ab9-d4e1d5c86f91 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:55.032403 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-774dd8da-3b0e-4cd0-8ab9-d4e1d5c86f91 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:55.033738 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-774dd8da-3b0e-4cd0-8ab9-d4e1d5c86f91 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:55.184178 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-774dd8da-3b0e-4cd0-8ab9-d4e1d5c86f91 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:55.193134 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-774dd8da-3b0e-4cd0-8ab9-d4e1d5c86f91 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.174726 Jul 21 22:36:55.193735 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 198/438] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:55 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:55.350169 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d1069ffd-1f6c-4052-8a38-6f75e4378a9c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:55.350923 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d1069ffd-1f6c-4052-8a38-6f75e4378a9c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:55.356816 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d1069ffd-1f6c-4052-8a38-6f75e4378a9c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:55.357255 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d1069ffd-1f6c-4052-8a38-6f75e4378a9c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:55.358019 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d1069ffd-1f6c-4052-8a38-6f75e4378a9c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:55.358443 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d1069ffd-1f6c-4052-8a38-6f75e4378a9c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:55.512574 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d1069ffd-1f6c-4052-8a38-6f75e4378a9c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:55.521413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d1069ffd-1f6c-4052-8a38-6f75e4378a9c tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.175177 Jul 21 22:36:55.521994 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 241/439] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:55 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:56.211006 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4330e690-7e3d-4d7c-8280-de38bc418813 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:56.211712 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4330e690-7e3d-4d7c-8280-de38bc418813 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:56.218553 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4330e690-7e3d-4d7c-8280-de38bc418813 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:56.219002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4330e690-7e3d-4d7c-8280-de38bc418813 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:56.219841 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4330e690-7e3d-4d7c-8280-de38bc418813 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:56.220286 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4330e690-7e3d-4d7c-8280-de38bc418813 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:56.353449 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4330e690-7e3d-4d7c-8280-de38bc418813 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:56.362401 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4330e690-7e3d-4d7c-8280-de38bc418813 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.155172 Jul 21 22:36:56.362980 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 199/440] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:56 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:56.538101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-65e9dfa6-49fd-495d-9771-93b4c134a8c8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:56.538673 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-65e9dfa6-49fd-495d-9771-93b4c134a8c8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:56.544737 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65e9dfa6-49fd-495d-9771-93b4c134a8c8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:56.545175 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65e9dfa6-49fd-495d-9771-93b4c134a8c8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:56.545959 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65e9dfa6-49fd-495d-9771-93b4c134a8c8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:56.546385 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-65e9dfa6-49fd-495d-9771-93b4c134a8c8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:56.702692 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-65e9dfa6-49fd-495d-9771-93b4c134a8c8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:56.712007 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-65e9dfa6-49fd-495d-9771-93b4c134a8c8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.177912 Jul 21 22:36:56.712570 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 242/441] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:56 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:57.380338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-35d21f2d-5dce-4b1f-8d4b-5552c8bebffc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:57.380948 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-35d21f2d-5dce-4b1f-8d4b-5552c8bebffc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:57.387806 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-35d21f2d-5dce-4b1f-8d4b-5552c8bebffc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:57.388256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-35d21f2d-5dce-4b1f-8d4b-5552c8bebffc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:57.389042 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-35d21f2d-5dce-4b1f-8d4b-5552c8bebffc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:57.389481 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-35d21f2d-5dce-4b1f-8d4b-5552c8bebffc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:57.550346 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-35d21f2d-5dce-4b1f-8d4b-5552c8bebffc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:57.559985 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-35d21f2d-5dce-4b1f-8d4b-5552c8bebffc tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.183897 Jul 21 22:36:57.560612 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 200/442] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:57 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:57.730158 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-df3d3fef-c91f-4863-a8bf-ad1806452df6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:57.730807 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-df3d3fef-c91f-4863-a8bf-ad1806452df6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:57.738281 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-df3d3fef-c91f-4863-a8bf-ad1806452df6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:57.738726 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-df3d3fef-c91f-4863-a8bf-ad1806452df6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:57.739547 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-df3d3fef-c91f-4863-a8bf-ad1806452df6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:57.739983 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-df3d3fef-c91f-4863-a8bf-ad1806452df6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:57.900196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-df3d3fef-c91f-4863-a8bf-ad1806452df6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:57.908471 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-df3d3fef-c91f-4863-a8bf-ad1806452df6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.182359 Jul 21 22:36:57.909054 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 243/443] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:57 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:58.578171 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3bbbd57d-ca84-4be0-b7a0-24eb678ba028 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:58.578791 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3bbbd57d-ca84-4be0-b7a0-24eb678ba028 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:58.585898 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3bbbd57d-ca84-4be0-b7a0-24eb678ba028 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:58.586348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3bbbd57d-ca84-4be0-b7a0-24eb678ba028 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:58.587152 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3bbbd57d-ca84-4be0-b7a0-24eb678ba028 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:58.587602 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3bbbd57d-ca84-4be0-b7a0-24eb678ba028 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:58.748894 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3bbbd57d-ca84-4be0-b7a0-24eb678ba028 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:58.757911 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3bbbd57d-ca84-4be0-b7a0-24eb678ba028 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.183887 Jul 21 22:36:58.758509 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 201/444] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:58 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:58.925672 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6997a4c1-0387-43c3-8e4b-4c5ea473ae37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:58.926544 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6997a4c1-0387-43c3-8e4b-4c5ea473ae37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:58.932711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6997a4c1-0387-43c3-8e4b-4c5ea473ae37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:58.933131 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6997a4c1-0387-43c3-8e4b-4c5ea473ae37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:58.933875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6997a4c1-0387-43c3-8e4b-4c5ea473ae37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:58.934383 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6997a4c1-0387-43c3-8e4b-4c5ea473ae37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:59.087373 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6997a4c1-0387-43c3-8e4b-4c5ea473ae37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:59.095788 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6997a4c1-0387-43c3-8e4b-4c5ea473ae37 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.174067 Jul 21 22:36:59.096380 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 244/445] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:58 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:59.775725 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-76056e59-f6ce-47b4-9e0b-cac1248ffdfe tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:59.776501 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-76056e59-f6ce-47b4-9e0b-cac1248ffdfe tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:59.783581 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76056e59-f6ce-47b4-9e0b-cac1248ffdfe tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:59.784024 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76056e59-f6ce-47b4-9e0b-cac1248ffdfe tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:59.784829 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76056e59-f6ce-47b4-9e0b-cac1248ffdfe tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:59.785260 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76056e59-f6ce-47b4-9e0b-cac1248ffdfe tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:59.928638 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-76056e59-f6ce-47b4-9e0b-cac1248ffdfe tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:59.936898 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-76056e59-f6ce-47b4-9e0b-cac1248ffdfe tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.165093 Jul 21 22:36:59.937484 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 202/446] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:59 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:00.114479 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-fc182210-9aea-4fdc-89b4-fefd515941d6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:00.115151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-fc182210-9aea-4fdc-89b4-fefd515941d6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:00.121274 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fc182210-9aea-4fdc-89b4-fefd515941d6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:00.121713 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fc182210-9aea-4fdc-89b4-fefd515941d6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:00.122479 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fc182210-9aea-4fdc-89b4-fefd515941d6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:00.122906 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fc182210-9aea-4fdc-89b4-fefd515941d6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:00.284875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-fc182210-9aea-4fdc-89b4-fefd515941d6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:00.292972 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-fc182210-9aea-4fdc-89b4-fefd515941d6 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.183820 Jul 21 22:37:00.293549 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 245/447] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:00 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:00.954911 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c9defd2a-8b05-43f1-bae3-75a3147e3921 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:00.955606 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c9defd2a-8b05-43f1-bae3-75a3147e3921 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:00.962044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c9defd2a-8b05-43f1-bae3-75a3147e3921 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:00.962551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c9defd2a-8b05-43f1-bae3-75a3147e3921 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:00.963405 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c9defd2a-8b05-43f1-bae3-75a3147e3921 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:00.963919 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c9defd2a-8b05-43f1-bae3-75a3147e3921 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:01.105744 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c9defd2a-8b05-43f1-bae3-75a3147e3921 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:01.115783 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c9defd2a-8b05-43f1-bae3-75a3147e3921 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.164925 Jul 21 22:37:01.116376 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 203/448] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:00 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:01.310501 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-22f2531f-aadb-47c6-ae3b-7096f7155208 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:01.311090 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-22f2531f-aadb-47c6-ae3b-7096f7155208 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:01.318538 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-22f2531f-aadb-47c6-ae3b-7096f7155208 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:01.318992 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-22f2531f-aadb-47c6-ae3b-7096f7155208 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:01.319800 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-22f2531f-aadb-47c6-ae3b-7096f7155208 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:01.320233 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-22f2531f-aadb-47c6-ae3b-7096f7155208 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:01.478105 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-22f2531f-aadb-47c6-ae3b-7096f7155208 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:01.486920 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-22f2531f-aadb-47c6-ae3b-7096f7155208 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.180280 Jul 21 22:37:01.487438 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 246/449] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:01 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:02.133094 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-18d72d6e-df85-4c08-9fb6-b5107bede5e2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:02.136174 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-18d72d6e-df85-4c08-9fb6-b5107bede5e2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:02.140507 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-18d72d6e-df85-4c08-9fb6-b5107bede5e2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:02.140964 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-18d72d6e-df85-4c08-9fb6-b5107bede5e2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:02.141750 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-18d72d6e-df85-4c08-9fb6-b5107bede5e2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:02.142189 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-18d72d6e-df85-4c08-9fb6-b5107bede5e2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:02.292475 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-18d72d6e-df85-4c08-9fb6-b5107bede5e2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:02.301997 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-18d72d6e-df85-4c08-9fb6-b5107bede5e2 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.172617 Jul 21 22:37:02.302762 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 204/450] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:02 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:02.505377 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6c35ad4a-211f-40f8-897a-026dbc0705e8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:02.506027 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6c35ad4a-211f-40f8-897a-026dbc0705e8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:02.512498 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c35ad4a-211f-40f8-897a-026dbc0705e8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:02.512948 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c35ad4a-211f-40f8-897a-026dbc0705e8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:02.513716 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c35ad4a-211f-40f8-897a-026dbc0705e8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:02.514149 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c35ad4a-211f-40f8-897a-026dbc0705e8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:02.667365 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6c35ad4a-211f-40f8-897a-026dbc0705e8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:02.675580 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6c35ad4a-211f-40f8-897a-026dbc0705e8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1757 microversion: 2.1 time: 0.175007 Jul 21 22:37:02.676160 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 247/451] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:02 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:03.325155 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e15c8c59-0989-4451-a557-f8b8260001d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:03.325791 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e15c8c59-0989-4451-a557-f8b8260001d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:03.332781 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e15c8c59-0989-4451-a557-f8b8260001d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:03.333531 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e15c8c59-0989-4451-a557-f8b8260001d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:03.334590 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e15c8c59-0989-4451-a557-f8b8260001d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:03.335251 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e15c8c59-0989-4451-a557-f8b8260001d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:03.477336 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e15c8c59-0989-4451-a557-f8b8260001d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:03.485449 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e15c8c59-0989-4451-a557-f8b8260001d8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.164298 Jul 21 22:37:03.486024 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 205/452] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:03 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:03.693415 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cc31e9d5-0c20-49a3-90d2-0c948e0355cd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:03.694027 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-cc31e9d5-0c20-49a3-90d2-0c948e0355cd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:03.700441 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc31e9d5-0c20-49a3-90d2-0c948e0355cd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:03.700882 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc31e9d5-0c20-49a3-90d2-0c948e0355cd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:03.701665 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc31e9d5-0c20-49a3-90d2-0c948e0355cd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:03.702094 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc31e9d5-0c20-49a3-90d2-0c948e0355cd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:03.857753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cc31e9d5-0c20-49a3-90d2-0c948e0355cd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:03.866639 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-cc31e9d5-0c20-49a3-90d2-0c948e0355cd tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1760 microversion: 2.1 time: 0.177254 Jul 21 22:37:03.867198 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 248/453] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:03 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1760 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:04.504351 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0a95e56c-399f-4239-9456-9a5185857faa tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:04.504922 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0a95e56c-399f-4239-9456-9a5185857faa tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:04.511986 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0a95e56c-399f-4239-9456-9a5185857faa tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:04.512437 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0a95e56c-399f-4239-9456-9a5185857faa tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:04.513223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0a95e56c-399f-4239-9456-9a5185857faa tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:04.513662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0a95e56c-399f-4239-9456-9a5185857faa tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:04.518991 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:04.653196 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-0a95e56c-399f-4239-9456-9a5185857faa tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:04.663549 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0a95e56c-399f-4239-9456-9a5185857faa tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.163480 Jul 21 22:37:04.664298 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 206/454] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:04 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:05.681161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2be0cc5c-9c7a-4ce1-92ad-d645882ec6fd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:05.681757 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2be0cc5c-9c7a-4ce1-92ad-d645882ec6fd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:05.687923 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2be0cc5c-9c7a-4ce1-92ad-d645882ec6fd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:05.688360 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2be0cc5c-9c7a-4ce1-92ad-d645882ec6fd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:05.689122 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2be0cc5c-9c7a-4ce1-92ad-d645882ec6fd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:05.690528 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2be0cc5c-9c7a-4ce1-92ad-d645882ec6fd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:05.712311 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:05.838583 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2be0cc5c-9c7a-4ce1-92ad-d645882ec6fd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:05.847211 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2be0cc5c-9c7a-4ce1-92ad-d645882ec6fd tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.169802 Jul 21 22:37:05.847806 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 249/455] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:05 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:06.865174 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1ddeff09-2020-4c33-8d55-f010b8e7ba40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:06.865832 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1ddeff09-2020-4c33-8d55-f010b8e7ba40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:06.873068 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ddeff09-2020-4c33-8d55-f010b8e7ba40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:06.873518 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ddeff09-2020-4c33-8d55-f010b8e7ba40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:06.874301 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ddeff09-2020-4c33-8d55-f010b8e7ba40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:06.874741 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ddeff09-2020-4c33-8d55-f010b8e7ba40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:07.019473 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1ddeff09-2020-4c33-8d55-f010b8e7ba40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:07.028866 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1ddeff09-2020-4c33-8d55-f010b8e7ba40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.168236 Jul 21 22:37:07.029515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 207/456] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:06 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:08.047124 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-208c786d-bee9-4557-996a-794bc101803f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:08.047750 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-208c786d-bee9-4557-996a-794bc101803f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:08.055517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-208c786d-bee9-4557-996a-794bc101803f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:08.055966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-208c786d-bee9-4557-996a-794bc101803f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:08.056739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-208c786d-bee9-4557-996a-794bc101803f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:08.057165 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-208c786d-bee9-4557-996a-794bc101803f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:08.201470 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-208c786d-bee9-4557-996a-794bc101803f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:08.211125 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-208c786d-bee9-4557-996a-794bc101803f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.167927 Jul 21 22:37:08.211726 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 250/457] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:08 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:09.229398 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1cb0af8e-aeaf-43c1-be31-da3efeeb6a30 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:09.230126 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1cb0af8e-aeaf-43c1-be31-da3efeeb6a30 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:09.238264 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1cb0af8e-aeaf-43c1-be31-da3efeeb6a30 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:09.238765 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1cb0af8e-aeaf-43c1-be31-da3efeeb6a30 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:09.239560 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1cb0af8e-aeaf-43c1-be31-da3efeeb6a30 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:09.240023 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1cb0af8e-aeaf-43c1-be31-da3efeeb6a30 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:09.391551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1cb0af8e-aeaf-43c1-be31-da3efeeb6a30 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:09.401259 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1cb0af8e-aeaf-43c1-be31-da3efeeb6a30 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.176149 Jul 21 22:37:09.401736 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 208/458] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:09 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:10.420605 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-39189afa-5cb8-4ae9-94fa-be9183fb9d5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:10.421259 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-39189afa-5cb8-4ae9-94fa-be9183fb9d5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:10.429110 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39189afa-5cb8-4ae9-94fa-be9183fb9d5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:10.429624 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39189afa-5cb8-4ae9-94fa-be9183fb9d5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:10.430401 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39189afa-5cb8-4ae9-94fa-be9183fb9d5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:10.430833 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39189afa-5cb8-4ae9-94fa-be9183fb9d5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:10.580861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-39189afa-5cb8-4ae9-94fa-be9183fb9d5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:10.591763 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-39189afa-5cb8-4ae9-94fa-be9183fb9d5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.175275 Jul 21 22:37:10.592574 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 251/459] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:10 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:11.613106 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1e39795c-cee1-464b-8c1d-4ec3f1b8e7df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:11.614021 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1e39795c-cee1-464b-8c1d-4ec3f1b8e7df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:11.620674 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1e39795c-cee1-464b-8c1d-4ec3f1b8e7df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:11.621115 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1e39795c-cee1-464b-8c1d-4ec3f1b8e7df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:11.621905 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1e39795c-cee1-464b-8c1d-4ec3f1b8e7df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:11.622454 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1e39795c-cee1-464b-8c1d-4ec3f1b8e7df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:11.778009 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1e39795c-cee1-464b-8c1d-4ec3f1b8e7df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:11.786788 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1e39795c-cee1-464b-8c1d-4ec3f1b8e7df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.179003 Jul 21 22:37:11.787421 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 209/460] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:11 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:12.760085 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8db324c9-4be7-45d3-8e3a-ceb858c8fa71 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:12.760684 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8db324c9-4be7-45d3-8e3a-ceb858c8fa71 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:12.767956 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8db324c9-4be7-45d3-8e3a-ceb858c8fa71 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:12.769099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8db324c9-4be7-45d3-8e3a-ceb858c8fa71 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:12.769883 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8db324c9-4be7-45d3-8e3a-ceb858c8fa71 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:12.770324 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8db324c9-4be7-45d3-8e3a-ceb858c8fa71 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:12.799298 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8db324c9-4be7-45d3-8e3a-ceb858c8fa71 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3/ips" status: 200 len: 148 microversion: 2.1 time: 0.042776 Jul 21 22:37:12.800088 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 252/461] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 22:37:12 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:12.811655 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-98d96fb5-e95a-42a5-8812-5e87c483d094 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:12.812281 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-98d96fb5-e95a-42a5-8812-5e87c483d094 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:12.814801 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4431b6d2-c088-4aeb-9f9c-a95e5b7a59d9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "684e15e4-6eb1-44a6-aab1-2484b62fa473"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:12.816979 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4431b6d2-c088-4aeb-9f9c-a95e5b7a59d9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:12.819463 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98d96fb5-e95a-42a5-8812-5e87c483d094 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:12.819917 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98d96fb5-e95a-42a5-8812-5e87c483d094 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:12.820708 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98d96fb5-e95a-42a5-8812-5e87c483d094 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:12.821146 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98d96fb5-e95a-42a5-8812-5e87c483d094 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:12.826715 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4431b6d2-c088-4aeb-9f9c-a95e5b7a59d9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:12.827243 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4431b6d2-c088-4aeb-9f9c-a95e5b7a59d9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:12.828071 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4431b6d2-c088-4aeb-9f9c-a95e5b7a59d9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:12.828516 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4431b6d2-c088-4aeb-9f9c-a95e5b7a59d9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:12.937277 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-4431b6d2-c088-4aeb-9f9c-a95e5b7a59d9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Invalid volume: volume 684e15e4-6eb1-44a6-aab1-2484b62fa473 is already attached to instances: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4431b6d2-c088-4aeb-9f9c-a95e5b7a59d9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: POST /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3/os-volume_attachments HTTP/1.1 Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 74 Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:37:12.939396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {"volumeAttachment": {"volumeId": "684e15e4-6eb1-44a6-aab1-2484b62fa473"}} Jul 21 22:37:12.946837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Invalid volume: volume 684e15e4-6eb1-44a6-aab1-2484b62fa473 is already attached to instances: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'server_id': 'a1438311-05a8-4296-8299-b04c1702a3a3', 'body': {'volumeAttachment': {'volumeId': '684e15e4-6eb1-44a6-aab1-2484b62fa473'}}} Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 684e15e4-6eb1-44a6-aab1-2484b62fa473 is already attached to instances: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:12.948890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 684e15e4-6eb1-44a6-aab1-2484b62fa473 is already attached to instances: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:12.953014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:12.955909 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:12.955909 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:37:12.955909 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:37:12.955909 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 684e15e4-6eb1-44a6-aab1-2484b62fa473 is already attached to instances: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f Jul 21 22:37:12.955909 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:12.955909 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4431b6d2-c088-4aeb-9f9c-a95e5b7a59d9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 400 to user: Invalid volume: volume 684e15e4-6eb1-44a6-aab1-2484b62fa473 is already attached to instances: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:37:12.955909 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4431b6d2-c088-4aeb-9f9c-a95e5b7a59d9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.133848 Jul 21 22:37:12.955909 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 210/462] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:37:12 2022] POST /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:37:12.956883 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-cc005bbc-7c82-47f7-999d-ff83a892eb26 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:12.957147 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-cc005bbc-7c82-47f7-999d-ff83a892eb26 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:12.967007 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cc005bbc-7c82-47f7-999d-ff83a892eb26 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:12.967542 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cc005bbc-7c82-47f7-999d-ff83a892eb26 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:12.968420 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cc005bbc-7c82-47f7-999d-ff83a892eb26 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:12.968801 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cc005bbc-7c82-47f7-999d-ff83a892eb26 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:13.005989 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-98d96fb5-e95a-42a5-8812-5e87c483d094 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:13.009564 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-cc005bbc-7c82-47f7-999d-ff83a892eb26 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:37:13.014812 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-98d96fb5-e95a-42a5-8812-5e87c483d094 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1736 microversion: 2.1 time: 0.207243 Jul 21 22:37:13.015433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 253/463] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:12 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:13.121814 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-cc005bbc-7c82-47f7-999d-ff83a892eb26 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 204 len: 0 microversion: 2.1 time: 0.171742 Jul 21 22:37:13.126089 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 211/464] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:37:12 2022] DELETE /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:37:13.132901 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-63f28b48-6745-4d9a-9859-eca946cc022c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:13.133637 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-63f28b48-6745-4d9a-9859-eca946cc022c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:13.141715 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-63f28b48-6745-4d9a-9859-eca946cc022c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:13.142369 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-63f28b48-6745-4d9a-9859-eca946cc022c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:13.144324 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-63f28b48-6745-4d9a-9859-eca946cc022c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:13.144882 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-63f28b48-6745-4d9a-9859-eca946cc022c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:13.295359 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-63f28b48-6745-4d9a-9859-eca946cc022c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:13.303850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-63f28b48-6745-4d9a-9859-eca946cc022c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1679 microversion: 2.1 time: 0.175966 Jul 21 22:37:13.304452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 254/465] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:13 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:14.035018 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0ee575fe-64af-487e-b8ce-28a7aa44cc63 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:14.035679 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0ee575fe-64af-487e-b8ce-28a7aa44cc63 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:14.042724 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0ee575fe-64af-487e-b8ce-28a7aa44cc63 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.043212 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0ee575fe-64af-487e-b8ce-28a7aa44cc63 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.044002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0ee575fe-64af-487e-b8ce-28a7aa44cc63 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.044440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0ee575fe-64af-487e-b8ce-28a7aa44cc63 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.186062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-0ee575fe-64af-487e-b8ce-28a7aa44cc63 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:14.195641 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0ee575fe-64af-487e-b8ce-28a7aa44cc63 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1716 microversion: 2.1 time: 0.165675 Jul 21 22:37:14.196246 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 212/466] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:14 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:14.318565 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-02c344cc-dcd3-4ffa-a713-afc9d549c81f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:14.319252 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-02c344cc-dcd3-4ffa-a713-afc9d549c81f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:14.325254 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6d688e1e-4527-48c0-b4d2-3cdbe49e55a7 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:14.325864 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-02c344cc-dcd3-4ffa-a713-afc9d549c81f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.326202 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-6d688e1e-4527-48c0-b4d2-3cdbe49e55a7 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:14.326308 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-02c344cc-dcd3-4ffa-a713-afc9d549c81f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.327138 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-02c344cc-dcd3-4ffa-a713-afc9d549c81f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.327585 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-02c344cc-dcd3-4ffa-a713-afc9d549c81f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.335802 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6d688e1e-4527-48c0-b4d2-3cdbe49e55a7 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.336247 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6d688e1e-4527-48c0-b4d2-3cdbe49e55a7 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.337306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6d688e1e-4527-48c0-b4d2-3cdbe49e55a7 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.338020 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6d688e1e-4527-48c0-b4d2-3cdbe49e55a7 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.420414 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-02c344cc-dcd3-4ffa-a713-afc9d549c81f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] HTTP exception thrown: Cannot 'detach_volume' instance c214c984-d0d9-4920-882c-6b481647edc5 while it is in vm_state rescued Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-02c344cc-dcd3-4ffa-a713-afc9d549c81f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Request method failure captured: Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: DELETE /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-volume_attachments/f00bc401-e488-458b-9825-157831fb1bea HTTP/1.1 Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQcy_G8ocjTOCjKfuQiJgav55FcHkpRzXV2eQjXzWDayGJS8w3BYSyBfL-Cs1UDOIt1B3j3O6nqOG9p2BeXrgzNDFMGpTB6FKm7m_uSZW9Uo2VLu24MyVG3Pb1Z8P536qLitexREcsNaSkF2h16ltZ1uA89QIYJo0KijJzLAxeNAN0 Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 3138cf3bb8a24ba19295565fca0a471e Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:37:14.422035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:37:14.424012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3138cf3bb8a24ba19295565fca0a471e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:37:14.424012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:37:14.424012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 3138cf3bb8a24ba19295565fca0a471e Jul 21 22:37:14.424012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:37:14.424012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-ServerRescueNegativeTestJSON-1702913491-project Jul 21 22:37:14.424012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:37:14.424012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:37:14.424012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: cf3fd4428e3b46cd9e83e1d32571097b Jul 21 22:37:14.424012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1702913491-project Jul 21 22:37:14.424012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:37:14.424012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Cannot 'detach_volume' instance c214c984-d0d9-4920-882c-6b481647edc5 while it is in vm_state rescued Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'server_id': 'c214c984-d0d9-4920-882c-6b481647edc5', 'id': 'f00bc401-e488-458b-9825-157831fb1bea'} Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c214c984-d0d9-4920-882c-6b481647edc5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:37:14.424685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c214c984-d0d9-4920-882c-6b481647edc5 while it is in vm_state rescued Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c214c984-d0d9-4920-882c-6b481647edc5 while it is in vm_state rescued Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:14.425903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-02c344cc-dcd3-4ffa-a713-afc9d549c81f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Returning 409 to user: Cannot 'detach_volume' instance c214c984-d0d9-4920-882c-6b481647edc5 while it is in vm_state rescued {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:37:14.426895 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-02c344cc-dcd3-4ffa-a713-afc9d549c81f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-volume_attachments/f00bc401-e488-458b-9825-157831fb1bea" status: 409 len: 152 microversion: 2.1 time: 0.111022 Jul 21 22:37:14.426895 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 255/467] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:37:14 2022] DELETE /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-volume_attachments/f00bc401-e488-458b-9825-157831fb1bea => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 22:37:14.436836 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0297a5cd-ce56-4041-abea-2af23ffb4d04 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:14.437732 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0297a5cd-ce56-4041-abea-2af23ffb4d04 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:14.446489 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0297a5cd-ce56-4041-abea-2af23ffb4d04 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.446935 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0297a5cd-ce56-4041-abea-2af23ffb4d04 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.448150 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0297a5cd-ce56-4041-abea-2af23ffb4d04 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.448602 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0297a5cd-ce56-4041-abea-2af23ffb4d04 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.523206 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0297a5cd-ce56-4041-abea-2af23ffb4d04 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "POST /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/action" status: 202 len: 0 microversion: 2.1 time: 0.092539 Jul 21 22:37:14.523438 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6d688e1e-4527-48c0-b4d2-3cdbe49e55a7 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:14.523843 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 256/468] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:37:14 2022] POST /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:37:14.531206 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6d688e1e-4527-48c0-b4d2-3cdbe49e55a7 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1679 microversion: 2.1 time: 0.211604 Jul 21 22:37:14.531800 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 213/469] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:14 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:14.534619 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3fbcdd18-2830-48f7-a785-f6799c7d4673 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:14.535358 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3fbcdd18-2830-48f7-a785-f6799c7d4673 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:14.542245 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3fbcdd18-2830-48f7-a785-f6799c7d4673 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.542693 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3fbcdd18-2830-48f7-a785-f6799c7d4673 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.543510 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3fbcdd18-2830-48f7-a785-f6799c7d4673 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.543950 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3fbcdd18-2830-48f7-a785-f6799c7d4673 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.725511 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3fbcdd18-2830-48f7-a785-f6799c7d4673 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:14.733858 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3fbcdd18-2830-48f7-a785-f6799c7d4673 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1724 microversion: 2.1 time: 0.204261 Jul 21 22:37:14.734441 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 257/470] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:14 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:15.557250 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-37bdf427-4aa6-4a6a-9946-f8caea98adbb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:15.557846 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-37bdf427-4aa6-4a6a-9946-f8caea98adbb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:15.560975 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:15.568777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37bdf427-4aa6-4a6a-9946-f8caea98adbb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:15.569396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37bdf427-4aa6-4a6a-9946-f8caea98adbb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:15.570434 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37bdf427-4aa6-4a6a-9946-f8caea98adbb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:15.570871 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-37bdf427-4aa6-4a6a-9946-f8caea98adbb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:15.662766 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-37bdf427-4aa6-4a6a-9946-f8caea98adbb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:15.681982 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-37bdf427-4aa6-4a6a-9946-f8caea98adbb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1611 microversion: 2.1 time: 0.128673 Jul 21 22:37:15.682577 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 214/471] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:15 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1611 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:15.755401 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2e729890-32f8-41ca-9605-7f38bb78a9da tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:15.756159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2e729890-32f8-41ca-9605-7f38bb78a9da tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:15.758925 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=47 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:15.769484 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e729890-32f8-41ca-9605-7f38bb78a9da tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:15.770270 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e729890-32f8-41ca-9605-7f38bb78a9da tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:15.771691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e729890-32f8-41ca-9605-7f38bb78a9da tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:15.772485 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e729890-32f8-41ca-9605-7f38bb78a9da tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:15.952833 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-f7352bc1-00e7-4d96-acf3-66997d5883f8 req-4a0cafab-8954-4c69-8518-4cc36c41a477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1438311-05a8-4296-8299-b04c1702a3a3", "name": "network-vif-deleted", "tag": "c05dbf3f-aef3-456a-8c56-37dd0824320f"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:15.966217 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-f7352bc1-00e7-4d96-acf3-66997d5883f8 req-4a0cafab-8954-4c69-8518-4cc36c41a477 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:15.966804 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-f7352bc1-00e7-4d96-acf3-66997d5883f8 req-4a0cafab-8954-4c69-8518-4cc36c41a477 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:15.984877 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-f7352bc1-00e7-4d96-acf3-66997d5883f8 req-4a0cafab-8954-4c69-8518-4cc36c41a477 service nova] Creating event network-vif-deleted:c05dbf3f-aef3-456a-8c56-37dd0824320f for instance a1438311-05a8-4296-8299-b04c1702a3a3 on hv-cinder-85069 Jul 21 22:37:15.993742 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-f7352bc1-00e7-4d96-acf3-66997d5883f8 req-4a0cafab-8954-4c69-8518-4cc36c41a477 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047220 Jul 21 22:37:15.994735 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 215/472] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:16.265440 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2e729890-32f8-41ca-9605-7f38bb78a9da tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:16.280349 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2e729890-32f8-41ca-9605-7f38bb78a9da tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1724 microversion: 2.1 time: 0.530823 Jul 21 22:37:16.280948 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 258/473] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:15 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1724 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:16.408851 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4822dad2-94a0-47e8-8b2e-6d1dc16e6d04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:16.409920 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4822dad2-94a0-47e8-8b2e-6d1dc16e6d04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:16.421710 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4822dad2-94a0-47e8-8b2e-6d1dc16e6d04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:16.422508 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4822dad2-94a0-47e8-8b2e-6d1dc16e6d04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:16.424576 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4822dad2-94a0-47e8-8b2e-6d1dc16e6d04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:16.425393 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4822dad2-94a0-47e8-8b2e-6d1dc16e6d04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:16.476486 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4822dad2-94a0-47e8-8b2e-6d1dc16e6d04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments/d39ac2df-88b2-4cb6-97c1-8956737307b6" status: 200 len: 194 microversion: 2.20 time: 0.076343 Jul 21 22:37:16.480071 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 216/474] 10.222.0.58 () {60 vars in 1453 bytes} [Thu Jul 21 22:37:16 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments/d39ac2df-88b2-4cb6-97c1-8956737307b6 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:37:16.569122 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-549256dc-b4f2-4991-831c-4288dd6c00c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:16.570014 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-549256dc-b4f2-4991-831c-4288dd6c00c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:16.577420 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-549256dc-b4f2-4991-831c-4288dd6c00c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:16.578159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-549256dc-b4f2-4991-831c-4288dd6c00c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:16.579043 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-549256dc-b4f2-4991-831c-4288dd6c00c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:16.579999 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-549256dc-b4f2-4991-831c-4288dd6c00c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:16.681663 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-549256dc-b4f2-4991-831c-4288dd6c00c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lazy-loading 'services' on Instance uuid bdafcf28-8b2d-4692-ba35-cd63d2c32de7 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:37:16.705283 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-508517c8-a41a-4513-a791-63be5ed77244 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:16.708188 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-508517c8-a41a-4513-a791-63be5ed77244 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:16.720669 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-508517c8-a41a-4513-a791-63be5ed77244 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:16.721590 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-508517c8-a41a-4513-a791-63be5ed77244 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:16.723160 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-508517c8-a41a-4513-a791-63be5ed77244 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:16.724096 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-508517c8-a41a-4513-a791-63be5ed77244 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:16.779034 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-549256dc-b4f2-4991-831c-4288dd6c00c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments/d39ac2df-88b2-4cb6-97c1-8956737307b6" status: 202 len: 0 microversion: 2.20 time: 0.214865 Jul 21 22:37:16.780613 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 259/475] 10.222.0.58 () {60 vars in 1456 bytes} [Thu Jul 21 22:37:16 2022] DELETE /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments/d39ac2df-88b2-4cb6-97c1-8956737307b6 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:37:16.792342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-360b0010-2623-4926-b85e-781d8466e959 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:16.793668 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-360b0010-2623-4926-b85e-781d8466e959 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:16.801855 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-360b0010-2623-4926-b85e-781d8466e959 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:16.802536 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-360b0010-2623-4926-b85e-781d8466e959 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:16.803539 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-360b0010-2623-4926-b85e-781d8466e959 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:16.804214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-360b0010-2623-4926-b85e-781d8466e959 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:16.836354 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-508517c8-a41a-4513-a791-63be5ed77244 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:16.842515 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-360b0010-2623-4926-b85e-781d8466e959 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053428 Jul 21 22:37:16.843459 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 260/476] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jul 21 22:37:16 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:37:16.850230 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-508517c8-a41a-4513-a791-63be5ed77244 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1611 microversion: 2.1 time: 0.152128 Jul 21 22:37:16.863512 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 217/477] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:16 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1611 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:17.300740 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-66a79a43-009f-4938-920c-06a5f293a9d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:17.301812 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-66a79a43-009f-4938-920c-06a5f293a9d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:17.311018 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66a79a43-009f-4938-920c-06a5f293a9d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:17.311731 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66a79a43-009f-4938-920c-06a5f293a9d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:17.312594 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66a79a43-009f-4938-920c-06a5f293a9d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:17.313128 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-66a79a43-009f-4938-920c-06a5f293a9d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:17.549174 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-66a79a43-009f-4938-920c-06a5f293a9d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:17.561293 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-66a79a43-009f-4938-920c-06a5f293a9d6 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1724 microversion: 2.1 time: 0.266384 Jul 21 22:37:17.562347 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 261/478] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:17 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:17.855794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b27e0fad-bbd9-46ea-b019-d019c44db4fa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:17.857227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b27e0fad-bbd9-46ea-b019-d019c44db4fa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:17.870265 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b27e0fad-bbd9-46ea-b019-d019c44db4fa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:17.873227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b27e0fad-bbd9-46ea-b019-d019c44db4fa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:17.873227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b27e0fad-bbd9-46ea-b019-d019c44db4fa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:17.873227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b27e0fad-bbd9-46ea-b019-d019c44db4fa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:17.883622 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-53c5da0a-95d0-45c5-a6da-0cca9fdf433b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:17.885446 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-53c5da0a-95d0-45c5-a6da-0cca9fdf433b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:17.896791 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-53c5da0a-95d0-45c5-a6da-0cca9fdf433b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:17.897437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-53c5da0a-95d0-45c5-a6da-0cca9fdf433b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:17.898836 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-53c5da0a-95d0-45c5-a6da-0cca9fdf433b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:17.899578 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-53c5da0a-95d0-45c5-a6da-0cca9fdf433b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:17.919599 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b27e0fad-bbd9-46ea-b019-d019c44db4fa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067785 Jul 21 22:37:17.920188 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 218/479] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jul 21 22:37:17 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:37:17.943789 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-53c5da0a-95d0-45c5-a6da-0cca9fdf433b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:17.944232 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-53c5da0a-95d0-45c5-a6da-0cca9fdf433b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:17.944682 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-53c5da0a-95d0-45c5-a6da-0cca9fdf433b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lazy-loading 'fault' on Instance uuid a1438311-05a8-4296-8299-b04c1702a3a3 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:37:18.013597 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-53c5da0a-95d0-45c5-a6da-0cca9fdf433b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:18.023671 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-53c5da0a-95d0-45c5-a6da-0cca9fdf433b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 200 len: 1330 microversion: 2.1 time: 0.146031 Jul 21 22:37:18.024494 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 262/480] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:17 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 1330 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:18.586462 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-752b6174-463a-4b31-8334-db1357348b33 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:18.587106 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-752b6174-463a-4b31-8334-db1357348b33 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:18.593851 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-752b6174-463a-4b31-8334-db1357348b33 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:18.594301 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-752b6174-463a-4b31-8334-db1357348b33 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:18.595697 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-752b6174-463a-4b31-8334-db1357348b33 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:18.596479 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-752b6174-463a-4b31-8334-db1357348b33 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:18.801586 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-752b6174-463a-4b31-8334-db1357348b33 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:18.817246 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-752b6174-463a-4b31-8334-db1357348b33 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1730 microversion: 2.1 time: 0.234476 Jul 21 22:37:18.818848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 219/481] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:18 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:18.850955 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-48caeeeb-47ad-4b0a-9d9e-8f73521ade8d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:18.852056 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-48caeeeb-47ad-4b0a-9d9e-8f73521ade8d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:18.861975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48caeeeb-47ad-4b0a-9d9e-8f73521ade8d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:18.863257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48caeeeb-47ad-4b0a-9d9e-8f73521ade8d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:18.865042 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48caeeeb-47ad-4b0a-9d9e-8f73521ade8d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:18.866132 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48caeeeb-47ad-4b0a-9d9e-8f73521ade8d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:18.937878 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8b0103e8-8ea1-48e5-ae07-5f601dbab765 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:18.940933 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-8b0103e8-8ea1-48e5-ae07-5f601dbab765 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:18.953889 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8b0103e8-8ea1-48e5-ae07-5f601dbab765 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:18.956041 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8b0103e8-8ea1-48e5-ae07-5f601dbab765 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:18.959607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8b0103e8-8ea1-48e5-ae07-5f601dbab765 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:18.962489 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8b0103e8-8ea1-48e5-ae07-5f601dbab765 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:18.984398 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-48caeeeb-47ad-4b0a-9d9e-8f73521ade8d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139612 Jul 21 22:37:18.986120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 263/482] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 22:37:18 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:19.043396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8b0103e8-8ea1-48e5-ae07-5f601dbab765 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113879 Jul 21 22:37:19.044869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cedbdf71-e2bf-4c55-9cde-5b71ff7d6df0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:19.046200 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-cedbdf71-e2bf-4c55-9cde-5b71ff7d6df0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:19.050294 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 220/483] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jul 21 22:37:18 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:37:19.060084 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cedbdf71-e2bf-4c55-9cde-5b71ff7d6df0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:19.061170 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cedbdf71-e2bf-4c55-9cde-5b71ff7d6df0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:19.061798 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cedbdf71-e2bf-4c55-9cde-5b71ff7d6df0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:19.062241 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cedbdf71-e2bf-4c55-9cde-5b71ff7d6df0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:19.083336 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-cedbdf71-e2bf-4c55-9cde-5b71ff7d6df0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cedbdf71-e2bf-4c55-9cde-5b71ff7d6df0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 HTTP/1.1 Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:37:19.085072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:37:19.086691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'a1438311-05a8-4296-8299-b04c1702a3a3'} Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:37:19.087478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:37:19.088765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:19.092855 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cedbdf71-e2bf-4c55-9cde-5b71ff7d6df0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:37:19.096319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-cedbdf71-e2bf-4c55-9cde-5b71ff7d6df0 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 404 len: 111 microversion: 2.1 time: 0.055044 Jul 21 22:37:19.097047 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 264/484] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:19 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:37:19.107665 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2f844a0d-f704-4f81-8b0e-62273106878c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '.version_select at 0x7f47e69d6dc0>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:19.147578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2f844a0d-f704-4f81-8b0e-62273106878c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-650590918" status: 202 len: 0 microversion: 2.1 time: 0.043959 Jul 21 22:37:19.151148 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 221/485] 10.222.0.58 () {58 vars in 1217 bytes} [Thu Jul 21 22:37:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-650590918 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:37:19.903186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-98d30826-3ff8-4c38-a9b8-0ebd91d75310 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:19.903947 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-98d30826-3ff8-4c38-a9b8-0ebd91d75310 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:19.911924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98d30826-3ff8-4c38-a9b8-0ebd91d75310 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:19.912371 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98d30826-3ff8-4c38-a9b8-0ebd91d75310 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:19.913177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98d30826-3ff8-4c38-a9b8-0ebd91d75310 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:19.913607 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-98d30826-3ff8-4c38-a9b8-0ebd91d75310 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:19.943876 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:20.029668 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-98d30826-3ff8-4c38-a9b8-0ebd91d75310 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lazy-loading 'services' on Instance uuid fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:37:20.058108 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-24ab87de-1e30-4f86-bd16-9f1443472d32 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:20.059248 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-24ab87de-1e30-4f86-bd16-9f1443472d32 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:20.067407 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-24ab87de-1e30-4f86-bd16-9f1443472d32 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:20.068086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-24ab87de-1e30-4f86-bd16-9f1443472d32 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:20.068980 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-24ab87de-1e30-4f86-bd16-9f1443472d32 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:20.069926 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-24ab87de-1e30-4f86-bd16-9f1443472d32 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:20.099937 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:20.105449 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-24ab87de-1e30-4f86-bd16-9f1443472d32 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051532 Jul 21 22:37:20.106592 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 222/486] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jul 21 22:37:20 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:20.141169 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-98d30826-3ff8-4c38-a9b8-0ebd91d75310 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments/684e15e4-6eb1-44a6-aab1-2484b62fa473" status: 202 len: 0 microversion: 2.1 time: 0.241880 Jul 21 22:37:20.143654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 265/487] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:37:19 2022] DELETE /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments/684e15e4-6eb1-44a6-aab1-2484b62fa473 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:37:20.163024 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8c58216c-3f0a-4c74-97a7-c7ca1161c04c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:20.165421 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-8c58216c-3f0a-4c74-97a7-c7ca1161c04c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:20.181522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8c58216c-3f0a-4c74-97a7-c7ca1161c04c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:20.182819 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8c58216c-3f0a-4c74-97a7-c7ca1161c04c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:20.184365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8c58216c-3f0a-4c74-97a7-c7ca1161c04c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:20.185476 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8c58216c-3f0a-4c74-97a7-c7ca1161c04c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:20.204633 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d93512de-c677-4719-9a0f-615322fe86b7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:20.205674 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d93512de-c677-4719-9a0f-615322fe86b7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:20.213975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d93512de-c677-4719-9a0f-615322fe86b7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:20.214564 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d93512de-c677-4719-9a0f-615322fe86b7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:20.215505 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d93512de-c677-4719-9a0f-615322fe86b7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:20.216068 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d93512de-c677-4719-9a0f-615322fe86b7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:20.230029 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8c58216c-3f0a-4c74-97a7-c7ca1161c04c tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082190 Jul 21 22:37:20.232917 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 223/488] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:37:20 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:37:20.261945 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d93512de-c677-4719-9a0f-615322fe86b7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Going to try to terminate instance {{(pid=124498) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:37:20.339100 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-2010b416-1087-4592-bcf3-ca4afd2d7793 req-2bc66ad9-51bf-4d9c-8873-c5acd31db374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c214c984-d0d9-4920-882c-6b481647edc5", "tag": "2474b6a6-f120-434b-bba6-8abb5364b833"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:20.354354 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-2010b416-1087-4592-bcf3-ca4afd2d7793 req-2bc66ad9-51bf-4d9c-8873-c5acd31db374 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:20.355933 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-2010b416-1087-4592-bcf3-ca4afd2d7793 req-2bc66ad9-51bf-4d9c-8873-c5acd31db374 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:20.383961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d93512de-c677-4719-9a0f-615322fe86b7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 204 len: 0 microversion: 2.20 time: 0.183790 Jul 21 22:37:20.385304 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 266/489] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jul 21 22:37:20 2022] DELETE /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 22:37:20.391200 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-2010b416-1087-4592-bcf3-ca4afd2d7793 req-2bc66ad9-51bf-4d9c-8873-c5acd31db374 service nova] Creating event network-changed:2474b6a6-f120-434b-bba6-8abb5364b833 for instance c214c984-d0d9-4920-882c-6b481647edc5 on hv-cinder-85069 Jul 21 22:37:20.398837 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-08ccbed1-3590-4513-b787-3330651a8815 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:20.400421 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-08ccbed1-3590-4513-b787-3330651a8815 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:20.401634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-2010b416-1087-4592-bcf3-ca4afd2d7793 req-2bc66ad9-51bf-4d9c-8873-c5acd31db374 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066546 Jul 21 22:37:20.402419 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 224/490] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:37:20.412515 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-08ccbed1-3590-4513-b787-3330651a8815 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:20.413308 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-08ccbed1-3590-4513-b787-3330651a8815 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:20.414727 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-08ccbed1-3590-4513-b787-3330651a8815 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:20.415552 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-08ccbed1-3590-4513-b787-3330651a8815 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:20.573103 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-08ccbed1-3590-4513-b787-3330651a8815 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:20.583208 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-08ccbed1-3590-4513-b787-3330651a8815 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:20.584853 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-08ccbed1-3590-4513-b787-3330651a8815 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:20.586120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-08ccbed1-3590-4513-b787-3330651a8815 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.195917 Jul 21 22:37:20.586906 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 267/491] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:20 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:21.247718 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-dadc880a-2648-46e8-a864-7861f5c62981 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:21.249600 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-dadc880a-2648-46e8-a864-7861f5c62981 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:21.262351 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dadc880a-2648-46e8-a864-7861f5c62981 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:21.263183 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dadc880a-2648-46e8-a864-7861f5c62981 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:21.264593 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dadc880a-2648-46e8-a864-7861f5c62981 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:21.265370 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dadc880a-2648-46e8-a864-7861f5c62981 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:21.326972 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-dadc880a-2648-46e8-a864-7861f5c62981 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087317 Jul 21 22:37:21.331111 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 225/492] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:37:21 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:21.606018 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5d772b13-1786-47bb-960d-41d8c2434ede tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:21.606793 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-5d772b13-1786-47bb-960d-41d8c2434ede tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:21.613844 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d772b13-1786-47bb-960d-41d8c2434ede tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:21.614280 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d772b13-1786-47bb-960d-41d8c2434ede tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:21.615073 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d772b13-1786-47bb-960d-41d8c2434ede tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:21.615525 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5d772b13-1786-47bb-960d-41d8c2434ede tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:21.800276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5d772b13-1786-47bb-960d-41d8c2434ede tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:21.815395 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5d772b13-1786-47bb-960d-41d8c2434ede tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:21.818306 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5d772b13-1786-47bb-960d-41d8c2434ede tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:21.820574 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5d772b13-1786-47bb-960d-41d8c2434ede tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.218261 Jul 21 22:37:21.821602 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 268/493] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:21 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:22.341246 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-39f38e46-6361-4ce9-8121-ec39d10b0271 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:22.342226 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-39f38e46-6361-4ce9-8121-ec39d10b0271 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:22.349865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-39f38e46-6361-4ce9-8121-ec39d10b0271 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:22.350314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-39f38e46-6361-4ce9-8121-ec39d10b0271 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:22.352353 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-39f38e46-6361-4ce9-8121-ec39d10b0271 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:22.352989 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-39f38e46-6361-4ce9-8121-ec39d10b0271 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:22.392721 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-39f38e46-6361-4ce9-8121-ec39d10b0271 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055459 Jul 21 22:37:22.398600 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 226/494] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:37:22 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:22.431350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-e6888053-b719-45c5-991b-160c6e4df2c4 req-2a8d6c38-3d35-4c03-a35d-d09bf09d0007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c214c984-d0d9-4920-882c-6b481647edc5", "tag": "2474b6a6-f120-434b-bba6-8abb5364b833"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:22.441140 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-e6888053-b719-45c5-991b-160c6e4df2c4 req-2a8d6c38-3d35-4c03-a35d-d09bf09d0007 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:22.441743 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-e6888053-b719-45c5-991b-160c6e4df2c4 req-2a8d6c38-3d35-4c03-a35d-d09bf09d0007 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:22.456844 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-e6888053-b719-45c5-991b-160c6e4df2c4 req-2a8d6c38-3d35-4c03-a35d-d09bf09d0007 service nova] Creating event network-changed:2474b6a6-f120-434b-bba6-8abb5364b833 for instance c214c984-d0d9-4920-882c-6b481647edc5 on hv-cinder-85069 Jul 21 22:37:22.464733 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-e6888053-b719-45c5-991b-160c6e4df2c4 req-2a8d6c38-3d35-4c03-a35d-d09bf09d0007 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036629 Jul 21 22:37:22.464733 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 269/495] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:37:22.840517 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-36f68532-17d7-4511-8202-2b2642619bdf tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:22.841818 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-36f68532-17d7-4511-8202-2b2642619bdf tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:22.848528 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-36f68532-17d7-4511-8202-2b2642619bdf tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:22.849237 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-36f68532-17d7-4511-8202-2b2642619bdf tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:22.850026 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-36f68532-17d7-4511-8202-2b2642619bdf tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:22.850458 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-36f68532-17d7-4511-8202-2b2642619bdf tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:23.139480 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-36f68532-17d7-4511-8202-2b2642619bdf tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:23.152804 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-36f68532-17d7-4511-8202-2b2642619bdf tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:23.154602 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-36f68532-17d7-4511-8202-2b2642619bdf tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:23.155946 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-36f68532-17d7-4511-8202-2b2642619bdf tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1723 microversion: 2.20 time: 0.319593 Jul 21 22:37:23.165383 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 227/496] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:22 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:37:23.407415 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d43e21a5-dd69-483f-958d-94ddfa374187 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:23.409703 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d43e21a5-dd69-483f-958d-94ddfa374187 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:23.427374 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d43e21a5-dd69-483f-958d-94ddfa374187 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:23.427845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d43e21a5-dd69-483f-958d-94ddfa374187 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:23.439274 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d43e21a5-dd69-483f-958d-94ddfa374187 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:23.445352 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d43e21a5-dd69-483f-958d-94ddfa374187 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:23.479176 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d43e21a5-dd69-483f-958d-94ddfa374187 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076446 Jul 21 22:37:23.486348 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 270/497] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:37:23 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:37:23.496906 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-639cb586-9476-43ad-af83-3d7f74a0872c req-667e34c5-923e-45b2-9959-9010655bba79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdafcf28-8b2d-4692-ba35-cd63d2c32de7", "name": "network-vif-deleted", "tag": "7beeb33e-b868-478b-961b-f1fcce969c8c"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:23.512639 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-639cb586-9476-43ad-af83-3d7f74a0872c req-667e34c5-923e-45b2-9959-9010655bba79 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:23.513325 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-639cb586-9476-43ad-af83-3d7f74a0872c req-667e34c5-923e-45b2-9959-9010655bba79 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:23.538497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-639cb586-9476-43ad-af83-3d7f74a0872c req-667e34c5-923e-45b2-9959-9010655bba79 service nova] Creating event network-vif-deleted:7beeb33e-b868-478b-961b-f1fcce969c8c for instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 on hv-cinder-85069 Jul 21 22:37:23.560793 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-639cb586-9476-43ad-af83-3d7f74a0872c req-667e34c5-923e-45b2-9959-9010655bba79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067234 Jul 21 22:37:23.561408 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 228/498] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:23.578451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-bf5aa858-9ed2-42be-88b9-952a19cf7700 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:23.580024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-bf5aa858-9ed2-42be-88b9-952a19cf7700 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:23.588320 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bf5aa858-9ed2-42be-88b9-952a19cf7700 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:23.589057 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bf5aa858-9ed2-42be-88b9-952a19cf7700 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:23.591466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bf5aa858-9ed2-42be-88b9-952a19cf7700 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:23.592124 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bf5aa858-9ed2-42be-88b9-952a19cf7700 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:23.624058 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-bf5aa858-9ed2-42be-88b9-952a19cf7700 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Going to try to terminate instance {{(pid=124498) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:37:23.726976 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-bf5aa858-9ed2-42be-88b9-952a19cf7700 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 204 len: 0 microversion: 2.1 time: 0.155750 Jul 21 22:37:23.727702 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 271/499] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:37:23 2022] DELETE /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:37:23.737247 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-52640e9a-f23b-4602-878a-015be6ea316e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:23.737945 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-52640e9a-f23b-4602-878a-015be6ea316e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:23.744849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-52640e9a-f23b-4602-878a-015be6ea316e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:23.745294 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-52640e9a-f23b-4602-878a-015be6ea316e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:23.746064 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-52640e9a-f23b-4602-878a-015be6ea316e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:23.746502 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-52640e9a-f23b-4602-878a-015be6ea316e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:23.883507 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-52640e9a-f23b-4602-878a-015be6ea316e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:23.892357 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-52640e9a-f23b-4602-878a-015be6ea316e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1681 microversion: 2.1 time: 0.159757 Jul 21 22:37:23.893207 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 229/500] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:23 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:24.175341 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:24.176044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:24.182055 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:24.182512 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:24.183311 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:24.183746 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:24.218479 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:24.218933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:24.219416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lazy-loading 'fault' on Instance uuid bdafcf28-8b2d-4692-ba35-cd63d2c32de7 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:37:24.275088 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:24.290408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:24.292666 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:24.294344 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f3a4d429-6591-4b16-8080-e9f5acfe8b04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1371 microversion: 2.20 time: 0.123140 Jul 21 22:37:24.305348 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 272/501] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:24 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:24.909944 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f34407ee-674b-4c07-a919-aabcd33cbb8f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:24.910546 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f34407ee-674b-4c07-a919-aabcd33cbb8f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:24.917314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f34407ee-674b-4c07-a919-aabcd33cbb8f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:24.917756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f34407ee-674b-4c07-a919-aabcd33cbb8f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:24.918553 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f34407ee-674b-4c07-a919-aabcd33cbb8f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:24.918988 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f34407ee-674b-4c07-a919-aabcd33cbb8f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:25.059432 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f34407ee-674b-4c07-a919-aabcd33cbb8f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:25.067270 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f34407ee-674b-4c07-a919-aabcd33cbb8f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1681 microversion: 2.1 time: 0.161242 Jul 21 22:37:25.067850 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 230/502] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:24 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:25.317998 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:25.318566 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:25.325166 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:25.325620 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:25.326418 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:25.326855 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:25.375249 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:25.376071 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:25.376880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lazy-loading 'fault' on Instance uuid bdafcf28-8b2d-4692-ba35-cd63d2c32de7 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:37:25.428549 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:25.437488 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:25.439258 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:25.440644 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-93b3037a-ac28-49c8-91bf-393728226745 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 200 len: 1371 microversion: 2.20 time: 0.126788 Jul 21 22:37:25.441318 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 273/503] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:25 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:26.088002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-56308eed-6157-4d4b-ba71-b8e8ce156c22 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:26.089168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-56308eed-6157-4d4b-ba71-b8e8ce156c22 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:26.099786 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-56308eed-6157-4d4b-ba71-b8e8ce156c22 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:26.100606 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-56308eed-6157-4d4b-ba71-b8e8ce156c22 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:26.101783 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-56308eed-6157-4d4b-ba71-b8e8ce156c22 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:26.102548 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-56308eed-6157-4d4b-ba71-b8e8ce156c22 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:26.287939 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-56308eed-6157-4d4b-ba71-b8e8ce156c22 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:26.297234 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-56308eed-6157-4d4b-ba71-b8e8ce156c22 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1681 microversion: 2.1 time: 0.216372 Jul 21 22:37:26.298285 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 231/504] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:26 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:26.460349 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3b1be6dc-af38-4704-bba7-e2bbde850214 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:26.461357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3b1be6dc-af38-4704-bba7-e2bbde850214 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:26.469467 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b1be6dc-af38-4704-bba7-e2bbde850214 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:26.470020 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b1be6dc-af38-4704-bba7-e2bbde850214 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:26.471126 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b1be6dc-af38-4704-bba7-e2bbde850214 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:26.472033 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b1be6dc-af38-4704-bba7-e2bbde850214 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:26.487585 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-3b1be6dc-af38-4704-bba7-e2bbde850214 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] HTTP exception thrown: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3b1be6dc-af38-4704-bba7-e2bbde850214 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Request method failure captured: Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 HTTP/1.1 Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQg645h1Z77ccb-z5-YQvDQL3xBwIL6ReOUksvRTm2kdgEuMcAXtPOoDto6wgXDp3yhmiU44YTcXfoDjxz-Bse6bR7GQ3tuQ_GiVuYcr1YY9RQ8JrWZ_fAiVTWHuZq768ugm7x3-4DVpfNcdfHHdMv1HFzNRro4O7WCb5aau8zI1Hw Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:37:26.489567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3b9849b45b2d414797c0cb368b787ddf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: a6146c8083d04171863a4b603fd6a46c Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:37:26.491638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'bdafcf28-8b2d-4692-ba35-cd63d2c32de7'} Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:37:26.493107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:37:26.495451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:37:26.497510 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3b1be6dc-af38-4704-bba7-e2bbde850214 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Returning 404 to user: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:37:26.497510 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3b1be6dc-af38-4704-bba7-e2bbde850214 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 404 len: 111 microversion: 2.20 time: 0.035738 Jul 21 22:37:26.497510 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 274/505] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:26 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:37:26.503815 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5fc56dc5-1445-49f3-a6fc-223702870164 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '.version_select at 0x7f47e6a871f0>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:26.525150 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-5fc56dc5-1445-49f3-a6fc-223702870164 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100871951" status: 204 len: 0 microversion: 2.20 time: 0.026491 Jul 21 22:37:26.525770 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 232/506] 10.222.0.58 () {60 vars in 1261 bytes} [Thu Jul 21 22:37:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100871951 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 22:37:26.656380 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-78494b1b-f7d1-49a9-b7f6-81914b036613 req-95cd2dc2-78cc-41ce-8791-70b4da96558f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f", "name": "network-vif-deleted", "tag": "f25b0df4-51a9-40a1-a6ef-86df601f88b6"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:26.683628 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-78494b1b-f7d1-49a9-b7f6-81914b036613 req-95cd2dc2-78cc-41ce-8791-70b4da96558f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:26.684627 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-78494b1b-f7d1-49a9-b7f6-81914b036613 req-95cd2dc2-78cc-41ce-8791-70b4da96558f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:26.719233 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-78494b1b-f7d1-49a9-b7f6-81914b036613 req-95cd2dc2-78cc-41ce-8791-70b4da96558f service nova] Creating event network-vif-deleted:f25b0df4-51a9-40a1-a6ef-86df601f88b6 for instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f on hv-cinder-85069 Jul 21 22:37:26.734273 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-78494b1b-f7d1-49a9-b7f6-81914b036613 req-95cd2dc2-78cc-41ce-8791-70b4da96558f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086170 Jul 21 22:37:26.740390 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 275/507] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:27.318422 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7f99d60f-3da8-4b9e-9fea-087c6ed4123d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:27.319965 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7f99d60f-3da8-4b9e-9fea-087c6ed4123d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:27.327637 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7f99d60f-3da8-4b9e-9fea-087c6ed4123d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:27.328469 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7f99d60f-3da8-4b9e-9fea-087c6ed4123d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:27.329499 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7f99d60f-3da8-4b9e-9fea-087c6ed4123d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:27.330450 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7f99d60f-3da8-4b9e-9fea-087c6ed4123d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:27.378488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7f99d60f-3da8-4b9e-9fea-087c6ed4123d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:27.379224 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7f99d60f-3da8-4b9e-9fea-087c6ed4123d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:27.379920 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-7f99d60f-3da8-4b9e-9fea-087c6ed4123d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lazy-loading 'fault' on Instance uuid fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:37:27.470384 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7f99d60f-3da8-4b9e-9fea-087c6ed4123d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:27.477592 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7f99d60f-3da8-4b9e-9fea-087c6ed4123d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 200 len: 1332 microversion: 2.1 time: 0.165265 Jul 21 22:37:27.478168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 233/508] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:27 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 1332 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:27.543965 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-36af7ea8-b410-49c3-b989-738b1dc1f4c1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Action: 'create', calling method: .version_select at 0x7f47e687ff70>, body: {"keypair": {"name": "tempest-keypair-1845647875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3v1Ezu4WO9XnBVCtu9HDz24MpdjkVYXTK7qU7dy5QLD7wDKjsr/4nnReqFw6xhP0H2n+mwt0uqs/7229I17VHarfThHajHXZ/2CcMUVRdxb8Ld0/d92y2BwQc9bSvaMQ=="}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:27.558401 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-36af7ea8-b410-49c3-b989-738b1dc1f4c1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Getting quotas for project 3b9849b45b2d414797c0cb368b787ddf. Resources: {'key_pairs'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:37:27.562513 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-36af7ea8-b410-49c3-b989-738b1dc1f4c1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Getting quotas for user a6146c8083d04171863a4b603fd6a46c and project 3b9849b45b2d414797c0cb368b787ddf. Resources: {'key_pairs'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:37:27.588402 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-36af7ea8-b410-49c3-b989-738b1dc1f4c1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048548 Jul 21 22:37:27.588930 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 276/509] 10.222.0.58 () {62 vars in 1199 bytes} [Thu Jul 21 22:37:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 22:37:28.494914 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3059fadd-5fcc-44fe-aca6-1d3b9117bbed tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:28.495545 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3059fadd-5fcc-44fe-aca6-1d3b9117bbed tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:28.502009 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3059fadd-5fcc-44fe-aca6-1d3b9117bbed tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:28.503029 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3059fadd-5fcc-44fe-aca6-1d3b9117bbed tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:28.503829 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3059fadd-5fcc-44fe-aca6-1d3b9117bbed tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:28.504282 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3059fadd-5fcc-44fe-aca6-1d3b9117bbed tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:28.520618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-3059fadd-5fcc-44fe-aca6-1d3b9117bbed tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3059fadd-5fcc-44fe-aca6-1d3b9117bbed tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f HTTP/1.1 Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:37:28.522478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:37:28.523868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f'} Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:37:28.524623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:37:28.526332 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:28.528136 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3059fadd-5fcc-44fe-aca6-1d3b9117bbed tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:37:28.528136 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3059fadd-5fcc-44fe-aca6-1d3b9117bbed tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 404 len: 111 microversion: 2.1 time: 0.032887 Jul 21 22:37:28.528136 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 234/510] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:28 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:37:28.535295 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-28670c8f-b12c-4ea6-a456-8c8dd1ccfce3 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '.version_select at 0x7f47e683eee0>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:28.554592 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-28670c8f-b12c-4ea6-a456-8c8dd1ccfce3 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326031101" status: 202 len: 0 microversion: 2.1 time: 0.025399 Jul 21 22:37:28.558691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 277/511] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jul 21 22:37:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326031101 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:37:29.196166 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1326718275", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97db9e2f-db43-41a4-8fd7-1761944b3315"}], "security_groups": [{"name": "tempest-securitygroup--326067281"}], "key_name": "tempest-keypair-1845647875", "user_data": "}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:29.258505 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0ff85338-6be6-4e02-8ce2-fd39956aacaf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: .version_select at 0x7f47e67a4700>, body: {"keypair": {"name": "tempest-keypair-1133580581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgq5HdF0BNOqpseTvOK++NKoHnGnUU7Re7XbU06uaDk/bNBzxV4TS44Dn+EVkyx7Pt9KcpNG5NuzknjEsheDN5b8N67rEALu961rPE/DQi8Z3xlXGF0KUw6XNPTnxxCIQ=="}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:29.275086 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-0ff85338-6be6-4e02-8ce2-fd39956aacaf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'key_pairs'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:37:29.279173 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-0ff85338-6be6-4e02-8ce2-fd39956aacaf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for user c4284eb173fc49d1b059fdd2f3de2b4d and project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'key_pairs'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:37:29.307390 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0ff85338-6be6-4e02-8ce2-fd39956aacaf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052979 Jul 21 22:37:29.308013 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 278/512] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 22:37:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:37:29.351464 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] validate_networks() for [('97db9e2f-db43-41a4-8fd7-1761944b3315', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:37:29.830841 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:37:29.831451 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:37:29.831780 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:37:29.832187 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:37:29.832596 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:37:29.842129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:29.842579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:29.843414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:29.843855 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:29.863755 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Getting quotas for project 3b9849b45b2d414797c0cb368b787ddf. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:37:29.867856 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Getting quotas for user a6146c8083d04171863a4b603fd6a46c and project 3b9849b45b2d414797c0cb368b787ddf. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:37:29.882330 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:37:29.884634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:37:29.933328 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-5f8a5988-2ed0-4628-847a-ead92ad8adc2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.743481 Jul 21 22:37:29.939024 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 235/513] 10.222.0.58 () {62 vars in 1187 bytes} [Thu Jul 21 22:37:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 22:37:29.944923 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5237276b-ecdc-4acf-8cb7-6c08385e39de tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:29.945841 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-5237276b-ecdc-4acf-8cb7-6c08385e39de tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:30.006670 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5237276b-ecdc-4acf-8cb7-6c08385e39de tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:30.015683 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5237276b-ecdc-4acf-8cb7-6c08385e39de tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:30.017139 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5237276b-ecdc-4acf-8cb7-6c08385e39de tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:30.019672 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5237276b-ecdc-4acf-8cb7-6c08385e39de tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1282 microversion: 2.20 time: 0.078883 Jul 21 22:37:30.020275 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 279/514] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:29 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:30.760586 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-240542780", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f846e054-e088-4d42-aada-300493577c1f"}], "security_groups": [{"name": "tempest-securitygroup--1802864281"}], "key_name": "tempest-keypair-1133580581", "user_data": "}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:31.039964 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3fcdae1c-b253-4625-8c4d-68904ef3dd40 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:31.040538 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3fcdae1c-b253-4625-8c4d-68904ef3dd40 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:31.047654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3fcdae1c-b253-4625-8c4d-68904ef3dd40 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:31.048224 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3fcdae1c-b253-4625-8c4d-68904ef3dd40 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:31.049856 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3fcdae1c-b253-4625-8c4d-68904ef3dd40 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:31.050512 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3fcdae1c-b253-4625-8c4d-68904ef3dd40 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:31.108222 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] validate_networks() for [('f846e054-e088-4d42-aada-300493577c1f', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:37:31.128690 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3fcdae1c-b253-4625-8c4d-68904ef3dd40 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:31.139364 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3fcdae1c-b253-4625-8c4d-68904ef3dd40 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:31.140894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3fcdae1c-b253-4625-8c4d-68904ef3dd40 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:31.142029 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3fcdae1c-b253-4625-8c4d-68904ef3dd40 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1342 microversion: 2.20 time: 0.106909 Jul 21 22:37:31.142897 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 280/515] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:31 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1342 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:31.573884 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:37:31.574890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:37:31.574890 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:37:31.575538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:37:31.575651 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:37:31.587402 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:31.587861 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:31.588719 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:31.589320 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:31.607849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:37:31.611695 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for user c4284eb173fc49d1b059fdd2f3de2b4d and project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:37:31.623101 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:37:31.625246 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:37:31.684774 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a7bb241e-ca28-44a3-8b43-2859fda80602 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.929014 Jul 21 22:37:31.686120 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 236/516] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:37:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:37:31.707268 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8e5cbd8e-cc9c-4b6f-9445-7c11c6b77414 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:31.708411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8e5cbd8e-cc9c-4b6f-9445-7c11c6b77414 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:31.775007 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8e5cbd8e-cc9c-4b6f-9445-7c11c6b77414 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:31.782455 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8e5cbd8e-cc9c-4b6f-9445-7c11c6b77414 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1241 microversion: 2.1 time: 0.089913 Jul 21 22:37:31.783034 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 281/517] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:31 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:32.161989 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4bf03207-e22b-441b-8e37-6078ae1d927f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:32.162601 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4bf03207-e22b-441b-8e37-6078ae1d927f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:32.169919 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4bf03207-e22b-441b-8e37-6078ae1d927f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:32.170433 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4bf03207-e22b-441b-8e37-6078ae1d927f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:32.171256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4bf03207-e22b-441b-8e37-6078ae1d927f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:32.171875 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4bf03207-e22b-441b-8e37-6078ae1d927f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:32.345442 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4bf03207-e22b-441b-8e37-6078ae1d927f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:32.358311 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4bf03207-e22b-441b-8e37-6078ae1d927f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:32.359849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4bf03207-e22b-441b-8e37-6078ae1d927f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:32.360971 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4bf03207-e22b-441b-8e37-6078ae1d927f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1407 microversion: 2.20 time: 0.203643 Jul 21 22:37:32.372894 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 237/518] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:32 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:32.547545 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-69639956-1acf-4b57-96cf-e81727b5e4ce req-b38b2bb3-24e9-4a50-8ac4-d6ab3600ad00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec3661d-93ec-46ac-9d30-188e8863b110", "tag": "a6bccf3e-2937-4ac6-854c-3de5f045836d"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:32.557133 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-69639956-1acf-4b57-96cf-e81727b5e4ce req-b38b2bb3-24e9-4a50-8ac4-d6ab3600ad00 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:32.557950 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-69639956-1acf-4b57-96cf-e81727b5e4ce req-b38b2bb3-24e9-4a50-8ac4-d6ab3600ad00 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:32.571933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-69639956-1acf-4b57-96cf-e81727b5e4ce req-b38b2bb3-24e9-4a50-8ac4-d6ab3600ad00 service nova] Creating event network-changed:a6bccf3e-2937-4ac6-854c-3de5f045836d for instance fec3661d-93ec-46ac-9d30-188e8863b110 on hv-cinder-85069 Jul 21 22:37:32.577435 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-69639956-1acf-4b57-96cf-e81727b5e4ce req-b38b2bb3-24e9-4a50-8ac4-d6ab3600ad00 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033798 Jul 21 22:37:32.578262 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 282/519] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:32.808983 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-640a7252-5faa-416c-86c6-9259f9b7e9e5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:32.821700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-640a7252-5faa-416c-86c6-9259f9b7e9e5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:32.842763 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-640a7252-5faa-416c-86c6-9259f9b7e9e5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:32.850017 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-640a7252-5faa-416c-86c6-9259f9b7e9e5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:32.852040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-640a7252-5faa-416c-86c6-9259f9b7e9e5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:32.853123 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-640a7252-5faa-416c-86c6-9259f9b7e9e5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:32.899879 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4b84916a-d09e-4d76-81c1-a1ad523b6471 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:32.902113 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4b84916a-d09e-4d76-81c1-a1ad523b6471 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:32.910615 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4b84916a-d09e-4d76-81c1-a1ad523b6471 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:32.911597 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4b84916a-d09e-4d76-81c1-a1ad523b6471 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:32.912862 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4b84916a-d09e-4d76-81c1-a1ad523b6471 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:32.913652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4b84916a-d09e-4d76-81c1-a1ad523b6471 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:32.949398 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4b84916a-d09e-4d76-81c1-a1ad523b6471 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057358 Jul 21 22:37:32.950555 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 283/520] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:37:32 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 22:37:32.983096 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-640a7252-5faa-416c-86c6-9259f9b7e9e5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:32.993582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-640a7252-5faa-416c-86c6-9259f9b7e9e5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1301 microversion: 2.1 time: 0.194347 Jul 21 22:37:32.994180 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 238/521] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:32 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1301 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:33.018261 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3042de68-b478-4e66-9f99-823c6916c1e8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:33.019229 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3042de68-b478-4e66-9f99-823c6916c1e8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:33.029679 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3042de68-b478-4e66-9f99-823c6916c1e8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:33.030213 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3042de68-b478-4e66-9f99-823c6916c1e8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:33.031099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3042de68-b478-4e66-9f99-823c6916c1e8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:33.031626 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3042de68-b478-4e66-9f99-823c6916c1e8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:33.061030 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3042de68-b478-4e66-9f99-823c6916c1e8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Going to try to terminate instance {{(pid=124498) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:37:33.078211 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:33.159427 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:33.173122 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3042de68-b478-4e66-9f99-823c6916c1e8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 204 len: 0 microversion: 2.1 time: 0.157254 Jul 21 22:37:33.173122 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 284/522] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:37:33 2022] DELETE /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:37:33.184719 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4541f703-7049-4536-8485-73c6caaf72ee tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:33.185500 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4541f703-7049-4536-8485-73c6caaf72ee tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:33.194483 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4541f703-7049-4536-8485-73c6caaf72ee tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:33.194935 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4541f703-7049-4536-8485-73c6caaf72ee tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:33.195759 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4541f703-7049-4536-8485-73c6caaf72ee tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:33.196196 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4541f703-7049-4536-8485-73c6caaf72ee tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:33.380721 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5ace424d-00e4-45b3-a9a5-bc0a1e3a3d59 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:33.381548 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-5ace424d-00e4-45b3-a9a5-bc0a1e3a3d59 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:33.389694 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4541f703-7049-4536-8485-73c6caaf72ee tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:33.389963 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5ace424d-00e4-45b3-a9a5-bc0a1e3a3d59 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:33.390382 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5ace424d-00e4-45b3-a9a5-bc0a1e3a3d59 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:33.391480 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5ace424d-00e4-45b3-a9a5-bc0a1e3a3d59 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:33.391927 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5ace424d-00e4-45b3-a9a5-bc0a1e3a3d59 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:33.401314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4541f703-7049-4536-8485-73c6caaf72ee tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1672 microversion: 2.1 time: 0.224177 Jul 21 22:37:33.401920 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 239/523] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:33 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1672 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:33.617492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5ace424d-00e4-45b3-a9a5-bc0a1e3a3d59 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:33.625831 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5ace424d-00e4-45b3-a9a5-bc0a1e3a3d59 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:33.627749 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5ace424d-00e4-45b3-a9a5-bc0a1e3a3d59 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:33.628640 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5ace424d-00e4-45b3-a9a5-bc0a1e3a3d59 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1407 microversion: 2.20 time: 0.252560 Jul 21 22:37:33.629211 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 285/524] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:33 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:37:34.010721 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-97b28907-cddc-4a94-a0a5-4ceb240dacfc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:34.011359 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-97b28907-cddc-4a94-a0a5-4ceb240dacfc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:34.017763 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-97b28907-cddc-4a94-a0a5-4ceb240dacfc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:34.018221 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-97b28907-cddc-4a94-a0a5-4ceb240dacfc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:34.018993 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-97b28907-cddc-4a94-a0a5-4ceb240dacfc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:34.019491 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-97b28907-cddc-4a94-a0a5-4ceb240dacfc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:34.168009 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-97b28907-cddc-4a94-a0a5-4ceb240dacfc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:34.178030 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-97b28907-cddc-4a94-a0a5-4ceb240dacfc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1367 microversion: 2.1 time: 0.171071 Jul 21 22:37:34.178538 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 240/525] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:34 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:34.418648 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6974e607-fdb4-4ed3-86e7-3cc3f761fb7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:34.419268 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6974e607-fdb4-4ed3-86e7-3cc3f761fb7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:34.425793 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6974e607-fdb4-4ed3-86e7-3cc3f761fb7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:34.426234 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6974e607-fdb4-4ed3-86e7-3cc3f761fb7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:34.426984 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6974e607-fdb4-4ed3-86e7-3cc3f761fb7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:34.427447 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6974e607-fdb4-4ed3-86e7-3cc3f761fb7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:34.563775 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6974e607-fdb4-4ed3-86e7-3cc3f761fb7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:34.571453 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6974e607-fdb4-4ed3-86e7-3cc3f761fb7a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1672 microversion: 2.1 time: 0.156638 Jul 21 22:37:34.572035 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 286/526] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:34 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:34.647304 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-11a6ec57-fb89-4ca2-9875-c9cf570d8631 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:34.648044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-11a6ec57-fb89-4ca2-9875-c9cf570d8631 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:34.664611 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-11a6ec57-fb89-4ca2-9875-c9cf570d8631 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:34.664611 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-11a6ec57-fb89-4ca2-9875-c9cf570d8631 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:34.665097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-11a6ec57-fb89-4ca2-9875-c9cf570d8631 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:34.665530 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-11a6ec57-fb89-4ca2-9875-c9cf570d8631 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:34.803072 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-11a6ec57-fb89-4ca2-9875-c9cf570d8631 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:34.811168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-11a6ec57-fb89-4ca2-9875-c9cf570d8631 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:34.812691 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-11a6ec57-fb89-4ca2-9875-c9cf570d8631 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:34.813793 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-11a6ec57-fb89-4ca2-9875-c9cf570d8631 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1407 microversion: 2.20 time: 0.171227 Jul 21 22:37:34.814837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 241/527] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:34 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:35.196768 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3a021ddd-8170-4ae4-85c0-108a510f4ad3 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:35.197439 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3a021ddd-8170-4ae4-85c0-108a510f4ad3 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:35.203951 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3a021ddd-8170-4ae4-85c0-108a510f4ad3 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:35.204400 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3a021ddd-8170-4ae4-85c0-108a510f4ad3 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:35.205190 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3a021ddd-8170-4ae4-85c0-108a510f4ad3 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:35.205630 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3a021ddd-8170-4ae4-85c0-108a510f4ad3 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:35.425329 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3a021ddd-8170-4ae4-85c0-108a510f4ad3 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:35.438683 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3a021ddd-8170-4ae4-85c0-108a510f4ad3 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1367 microversion: 2.1 time: 0.246084 Jul 21 22:37:35.446342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 287/528] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:35 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:35.589670 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-be680004-8539-45d7-aa92-00dd789bc3ef tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:35.591138 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-be680004-8539-45d7-aa92-00dd789bc3ef tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:35.598572 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-be680004-8539-45d7-aa92-00dd789bc3ef tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:35.599588 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-be680004-8539-45d7-aa92-00dd789bc3ef tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:35.600840 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-be680004-8539-45d7-aa92-00dd789bc3ef tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:35.601418 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-be680004-8539-45d7-aa92-00dd789bc3ef tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:35.833917 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-61941c07-3a24-4701-ae49-ba613a5e926b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:35.834794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-61941c07-3a24-4701-ae49-ba613a5e926b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:35.841879 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-61941c07-3a24-4701-ae49-ba613a5e926b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:35.842247 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-61941c07-3a24-4701-ae49-ba613a5e926b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:35.843226 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-61941c07-3a24-4701-ae49-ba613a5e926b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:35.843846 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-61941c07-3a24-4701-ae49-ba613a5e926b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:35.849463 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-be680004-8539-45d7-aa92-00dd789bc3ef tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:35.857814 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-be680004-8539-45d7-aa92-00dd789bc3ef tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1672 microversion: 2.1 time: 0.272342 Jul 21 22:37:35.868677 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 242/529] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:35 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1672 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:35.974519 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-1e501fca-cd54-45b8-bdf7-c57c16c2e30b req-da5b9f19-1f9b-480d-ac07-83a40312b0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707386e1-842c-43e5-aee3-c9068abc8d02", "tag": "3b89f5f0-5c0a-4913-9efe-245565036ad6"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:35.988688 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-1e501fca-cd54-45b8-bdf7-c57c16c2e30b req-da5b9f19-1f9b-480d-ac07-83a40312b0c5 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:35.989458 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-1e501fca-cd54-45b8-bdf7-c57c16c2e30b req-da5b9f19-1f9b-480d-ac07-83a40312b0c5 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:36.018614 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-1e501fca-cd54-45b8-bdf7-c57c16c2e30b req-da5b9f19-1f9b-480d-ac07-83a40312b0c5 service nova] Creating event network-changed:3b89f5f0-5c0a-4913-9efe-245565036ad6 for instance 707386e1-842c-43e5-aee3-c9068abc8d02 on hv-cinder-85069 Jul 21 22:37:36.026067 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-1e501fca-cd54-45b8-bdf7-c57c16c2e30b req-da5b9f19-1f9b-480d-ac07-83a40312b0c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057395 Jul 21 22:37:36.027568 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 243/530] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:37:36.062600 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-61941c07-3a24-4701-ae49-ba613a5e926b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:36.071756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-61941c07-3a24-4701-ae49-ba613a5e926b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:36.073274 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-61941c07-3a24-4701-ae49-ba613a5e926b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:36.074605 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-61941c07-3a24-4701-ae49-ba613a5e926b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1407 microversion: 2.20 time: 0.246433 Jul 21 22:37:36.075374 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 288/531] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:35 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:37:36.457724 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e51b81f3-aa99-4e4e-a736-16890e5902fa tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:36.458599 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e51b81f3-aa99-4e4e-a736-16890e5902fa tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:36.465849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e51b81f3-aa99-4e4e-a736-16890e5902fa tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:36.466450 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e51b81f3-aa99-4e4e-a736-16890e5902fa tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:36.467523 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e51b81f3-aa99-4e4e-a736-16890e5902fa tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:36.468166 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e51b81f3-aa99-4e4e-a736-16890e5902fa tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:36.473956 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=100 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:36.488888 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-d450275f-0ea7-4c87-8375-4ef143138e1f req-cae43529-bca4-43a0-a1f5-8752551b6394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa905ed-e5e9-4837-8aca-77fff9f6d722", "name": "network-vif-deleted", "tag": "93173e49-e7da-4add-9d87-eb54a10842e3"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:36.500654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-d450275f-0ea7-4c87-8375-4ef143138e1f req-cae43529-bca4-43a0-a1f5-8752551b6394 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:36.501197 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-d450275f-0ea7-4c87-8375-4ef143138e1f req-cae43529-bca4-43a0-a1f5-8752551b6394 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:36.512695 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-d450275f-0ea7-4c87-8375-4ef143138e1f req-cae43529-bca4-43a0-a1f5-8752551b6394 service nova] Creating event network-vif-deleted:93173e49-e7da-4add-9d87-eb54a10842e3 for instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 on hv-cinder-85069 Jul 21 22:37:36.517943 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-d450275f-0ea7-4c87-8375-4ef143138e1f req-cae43529-bca4-43a0-a1f5-8752551b6394 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036776 Jul 21 22:37:36.519086 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 289/532] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:36.626067 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e51b81f3-aa99-4e4e-a736-16890e5902fa tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:36.634602 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e51b81f3-aa99-4e4e-a736-16890e5902fa tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1367 microversion: 2.1 time: 0.181200 Jul 21 22:37:36.635436 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 244/533] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:36 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:36.876994 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cfbe325b-9b5f-455f-9adc-092a79d9ce27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:36.878170 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-cfbe325b-9b5f-455f-9adc-092a79d9ce27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:36.895776 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cfbe325b-9b5f-455f-9adc-092a79d9ce27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:36.896310 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cfbe325b-9b5f-455f-9adc-092a79d9ce27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:36.897297 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cfbe325b-9b5f-455f-9adc-092a79d9ce27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:36.897671 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cfbe325b-9b5f-455f-9adc-092a79d9ce27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:36.940413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cfbe325b-9b5f-455f-9adc-092a79d9ce27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:36.941178 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cfbe325b-9b5f-455f-9adc-092a79d9ce27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:36.941618 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-cfbe325b-9b5f-455f-9adc-092a79d9ce27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lazy-loading 'fault' on Instance uuid ffa905ed-e5e9-4837-8aca-77fff9f6d722 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:37:36.988577 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cfbe325b-9b5f-455f-9adc-092a79d9ce27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:36.996500 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-cfbe325b-9b5f-455f-9adc-092a79d9ce27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 200 len: 1328 microversion: 2.1 time: 0.123724 Jul 21 22:37:36.997081 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 290/534] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:36 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 1328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:37.092681 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6a5131fb-aa7c-44b8-9fd3-d38e37bcaf04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:37.093337 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-6a5131fb-aa7c-44b8-9fd3-d38e37bcaf04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:37.096451 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:37.102039 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6a5131fb-aa7c-44b8-9fd3-d38e37bcaf04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:37.102484 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6a5131fb-aa7c-44b8-9fd3-d38e37bcaf04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:37.103282 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6a5131fb-aa7c-44b8-9fd3-d38e37bcaf04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:37.103722 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6a5131fb-aa7c-44b8-9fd3-d38e37bcaf04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:37.256844 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6a5131fb-aa7c-44b8-9fd3-d38e37bcaf04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:37.272853 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6a5131fb-aa7c-44b8-9fd3-d38e37bcaf04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:37.274461 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6a5131fb-aa7c-44b8-9fd3-d38e37bcaf04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:37.276530 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6a5131fb-aa7c-44b8-9fd3-d38e37bcaf04 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1407 microversion: 2.20 time: 0.187336 Jul 21 22:37:37.277630 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 245/535] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:37 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:37.652355 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-bda9f548-724c-47f4-8170-39623d21d765 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:37.652975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-bda9f548-724c-47f4-8170-39623d21d765 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:37.659614 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bda9f548-724c-47f4-8170-39623d21d765 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:37.660062 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bda9f548-724c-47f4-8170-39623d21d765 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:37.660842 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bda9f548-724c-47f4-8170-39623d21d765 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:37.661280 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bda9f548-724c-47f4-8170-39623d21d765 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:37.821569 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-bda9f548-724c-47f4-8170-39623d21d765 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:37.829782 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-bda9f548-724c-47f4-8170-39623d21d765 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1367 microversion: 2.1 time: 0.181660 Jul 21 22:37:37.830485 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 291/536] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:37 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:38.013981 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-03c6ed13-bac0-416d-bdf8-eebc90549cf3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:38.014504 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-03c6ed13-bac0-416d-bdf8-eebc90549cf3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:38.020877 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-03c6ed13-bac0-416d-bdf8-eebc90549cf3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:38.021319 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-03c6ed13-bac0-416d-bdf8-eebc90549cf3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:38.022083 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-03c6ed13-bac0-416d-bdf8-eebc90549cf3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:38.022520 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-03c6ed13-bac0-416d-bdf8-eebc90549cf3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:38.036830 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-03c6ed13-bac0-416d-bdf8-eebc90549cf3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] HTTP exception thrown: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-03c6ed13-bac0-416d-bdf8-eebc90549cf3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Request method failure captured: Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 HTTP/1.1 Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQi1Xc4z98kJuhUF6P8uCkoK6PbSXq6CQiVJBBqE3LFRIUraXG-GV3-7HuM1a3NR4N42DH0AfnRU8n_5W3BAFkW2pbdQDd9xxAIr7Zzpd0uRx4yxCQnmZCe0SdPrVCfKu-p6_WXh_efrRbSPcaATh-kAvY8egKOlfj_Qb4lJXhDJf4 Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:37:38.038497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d54636d00282483381454b9be56a43b5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d54636d00282483381454b9be56a43b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 1ee22783b3234c4f905fedce7d59f01d Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:37:38.040168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'ffa905ed-e5e9-4837-8aca-77fff9f6d722'} Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:37:38.041044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:37:38.042457 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:38.043833 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-03c6ed13-bac0-416d-bdf8-eebc90549cf3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Returning 404 to user: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:37:38.043833 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-03c6ed13-bac0-416d-bdf8-eebc90549cf3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 404 len: 111 microversion: 2.1 time: 0.030039 Jul 21 22:37:38.043833 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 246/537] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:38 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:37:38.049806 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3a77d52b-d96f-4a19-aa78-8ee6e52c6568 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '.version_select at 0x7f47e687fe50>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:38.067972 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3a77d52b-d96f-4a19-aa78-8ee6e52c6568 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272355326" status: 202 len: 0 microversion: 2.1 time: 0.022641 Jul 21 22:37:38.068549 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 292/538] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jul 21 22:37:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272355326 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:37:38.296472 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a7867e7b-ffc4-47be-8e42-d34cf73e85c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:38.297168 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a7867e7b-ffc4-47be-8e42-d34cf73e85c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:38.304077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7867e7b-ffc4-47be-8e42-d34cf73e85c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:38.304525 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7867e7b-ffc4-47be-8e42-d34cf73e85c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:38.305515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7867e7b-ffc4-47be-8e42-d34cf73e85c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:38.305954 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7867e7b-ffc4-47be-8e42-d34cf73e85c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:38.566296 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a7867e7b-ffc4-47be-8e42-d34cf73e85c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:38.574974 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a7867e7b-ffc4-47be-8e42-d34cf73e85c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:38.576755 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a7867e7b-ffc4-47be-8e42-d34cf73e85c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:38.577772 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a7867e7b-ffc4-47be-8e42-d34cf73e85c7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1407 microversion: 2.20 time: 0.285562 Jul 21 22:37:38.578345 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 247/539] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:38 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:37:38.848534 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-da7783d5-c005-4a4a-a9f3-b749526ae0fc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:38.849254 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-da7783d5-c005-4a4a-a9f3-b749526ae0fc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:38.858487 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-da7783d5-c005-4a4a-a9f3-b749526ae0fc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:38.858487 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-da7783d5-c005-4a4a-a9f3-b749526ae0fc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:38.858487 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-da7783d5-c005-4a4a-a9f3-b749526ae0fc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:38.858487 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-da7783d5-c005-4a4a-a9f3-b749526ae0fc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:38.883706 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9dbcb6da-9eba-4da9-a40e-5ebe6eca35c3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Action: 'create', calling method: .version_select at 0x7f47e6700940>, body: {"keypair": {"name": "tempest-keypair-1746645662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrdzgdTKxKdWpnDeRbY47YZALklkCcsuskXL2dsuUT0CTeO78r8kT+17Cwf68jxPeGR1eXJXe+usqhNuu1gr0FlXqM7ntubA4Wdp5VBLmIzxMg3pfSCNt0poCREY55Zbg=="}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:38.899508 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-9dbcb6da-9eba-4da9-a40e-5ebe6eca35c3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Getting quotas for project d54636d00282483381454b9be56a43b5. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:37:38.903665 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-9dbcb6da-9eba-4da9-a40e-5ebe6eca35c3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Getting quotas for user 1ee22783b3234c4f905fedce7d59f01d and project d54636d00282483381454b9be56a43b5. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:37:38.929592 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-9dbcb6da-9eba-4da9-a40e-5ebe6eca35c3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049670 Jul 21 22:37:38.930972 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 248/540] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 22:37:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:37:39.019195 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-da7783d5-c005-4a4a-a9f3-b749526ae0fc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:39.027161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-da7783d5-c005-4a4a-a9f3-b749526ae0fc tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1367 microversion: 2.1 time: 0.182786 Jul 21 22:37:39.027783 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 293/541] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:38 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:39.598937 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e3766979-a3e7-44c0-8615-3f2aa5ad4206 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:39.599648 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e3766979-a3e7-44c0-8615-3f2aa5ad4206 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:39.607026 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e3766979-a3e7-44c0-8615-3f2aa5ad4206 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:39.607520 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e3766979-a3e7-44c0-8615-3f2aa5ad4206 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:39.608298 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e3766979-a3e7-44c0-8615-3f2aa5ad4206 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:39.608806 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e3766979-a3e7-44c0-8615-3f2aa5ad4206 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:39.750339 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e3766979-a3e7-44c0-8615-3f2aa5ad4206 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:39.759635 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e3766979-a3e7-44c0-8615-3f2aa5ad4206 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:39.761142 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e3766979-a3e7-44c0-8615-3f2aa5ad4206 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:39.762271 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e3766979-a3e7-44c0-8615-3f2aa5ad4206 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1407 microversion: 2.20 time: 0.168343 Jul 21 22:37:39.762835 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 249/542] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:39 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:40.044695 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-54fc3461-f02e-4219-a8cc-b167bb3ff212 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:40.045973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-54fc3461-f02e-4219-a8cc-b167bb3ff212 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:40.053414 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-54fc3461-f02e-4219-a8cc-b167bb3ff212 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:40.054155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-54fc3461-f02e-4219-a8cc-b167bb3ff212 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:40.055221 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-54fc3461-f02e-4219-a8cc-b167bb3ff212 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:40.055897 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-54fc3461-f02e-4219-a8cc-b167bb3ff212 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:40.198324 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-54fc3461-f02e-4219-a8cc-b167bb3ff212 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:40.208163 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-54fc3461-f02e-4219-a8cc-b167bb3ff212 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1367 microversion: 2.1 time: 0.167167 Jul 21 22:37:40.208753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 294/543] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:40 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:40.506084 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-994722103", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99f805e3-2429-4430-a2c2-07da14cced17"}], "security_groups": [{"name": "tempest-securitygroup--951518084"}], "key_name": "tempest-keypair-1746645662", "user_data": "}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:40.616118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] validate_networks() for [('99f805e3-2429-4430-a2c2-07da14cced17', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:37:40.781452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cc5c08f9-886f-4b91-bf2b-7737fa5ceeeb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:40.782085 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-cc5c08f9-886f-4b91-bf2b-7737fa5ceeeb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:40.789419 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc5c08f9-886f-4b91-bf2b-7737fa5ceeeb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:40.789868 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc5c08f9-886f-4b91-bf2b-7737fa5ceeeb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:40.790634 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc5c08f9-886f-4b91-bf2b-7737fa5ceeeb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:40.791092 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc5c08f9-886f-4b91-bf2b-7737fa5ceeeb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:41.021172 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cc5c08f9-886f-4b91-bf2b-7737fa5ceeeb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:41.029597 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cc5c08f9-886f-4b91-bf2b-7737fa5ceeeb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:41.031138 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cc5c08f9-886f-4b91-bf2b-7737fa5ceeeb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:41.032286 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-cc5c08f9-886f-4b91-bf2b-7737fa5ceeeb tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1407 microversion: 2.20 time: 0.254828 Jul 21 22:37:41.032857 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 295/544] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:40 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:37:41.225858 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e88da78b-19a5-42fd-900f-8b6abaf00727 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:41.226557 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e88da78b-19a5-42fd-900f-8b6abaf00727 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:41.232644 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e88da78b-19a5-42fd-900f-8b6abaf00727 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:41.233092 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e88da78b-19a5-42fd-900f-8b6abaf00727 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:41.233889 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e88da78b-19a5-42fd-900f-8b6abaf00727 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:41.234324 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e88da78b-19a5-42fd-900f-8b6abaf00727 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:41.365992 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:37:41.366659 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:37:41.367016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:37:41.367452 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:37:41.367860 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:37:41.376998 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:41.377443 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:41.378917 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:41.379386 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:41.397716 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e88da78b-19a5-42fd-900f-8b6abaf00727 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:41.397877 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Getting quotas for project d54636d00282483381454b9be56a43b5. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:37:41.402050 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Getting quotas for user 1ee22783b3234c4f905fedce7d59f01d and project d54636d00282483381454b9be56a43b5. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:37:41.405791 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e88da78b-19a5-42fd-900f-8b6abaf00727 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1367 microversion: 2.1 time: 0.184503 Jul 21 22:37:41.406357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 296/545] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:41 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:41.414753 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:37:41.417059 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:37:41.467395 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-600cc759-cf66-486c-bdb1-9f298e3641d2 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.965605 Jul 21 22:37:41.468048 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 250/546] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:37:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:37:41.478477 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-adafebb1-069f-4e0b-b1c2-bc487ac5e598 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:41.479093 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-adafebb1-069f-4e0b-b1c2-bc487ac5e598 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:41.541595 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-adafebb1-069f-4e0b-b1c2-bc487ac5e598 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:41.548439 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-adafebb1-069f-4e0b-b1c2-bc487ac5e598 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1237 microversion: 2.1 time: 0.073728 Jul 21 22:37:41.549009 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 297/547] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:41 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:42.053118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-47124a7b-ca09-4671-89a6-129d4967b868 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:42.053983 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-47124a7b-ca09-4671-89a6-129d4967b868 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:42.061463 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-47124a7b-ca09-4671-89a6-129d4967b868 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:42.062121 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-47124a7b-ca09-4671-89a6-129d4967b868 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:42.063007 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-47124a7b-ca09-4671-89a6-129d4967b868 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:42.063575 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-47124a7b-ca09-4671-89a6-129d4967b868 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:42.211023 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-47124a7b-ca09-4671-89a6-129d4967b868 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:42.220110 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-47124a7b-ca09-4671-89a6-129d4967b868 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:42.222190 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-47124a7b-ca09-4671-89a6-129d4967b868 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:42.223637 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-47124a7b-ca09-4671-89a6-129d4967b868 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1407 microversion: 2.20 time: 0.176821 Jul 21 22:37:42.224219 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 251/548] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:42 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:42.428117 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-31413028-558b-42c8-bb7c-d1802778f9c2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:42.430098 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-31413028-558b-42c8-bb7c-d1802778f9c2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:42.440606 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-31413028-558b-42c8-bb7c-d1802778f9c2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:42.442407 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-31413028-558b-42c8-bb7c-d1802778f9c2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:42.460652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-31413028-558b-42c8-bb7c-d1802778f9c2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:42.461284 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-31413028-558b-42c8-bb7c-d1802778f9c2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:42.501355 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-f744e736-83af-413e-a600-1d70b5bb87b4 req-664f2ac2-58b8-4992-a0e4-0c8bfc5ff802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec3661d-93ec-46ac-9d30-188e8863b110", "name": "network-vif-plugged", "status": "completed", "tag": "a6bccf3e-2937-4ac6-854c-3de5f045836d"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:42.521263 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-f744e736-83af-413e-a600-1d70b5bb87b4 req-664f2ac2-58b8-4992-a0e4-0c8bfc5ff802 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:42.521714 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-f744e736-83af-413e-a600-1d70b5bb87b4 req-664f2ac2-58b8-4992-a0e4-0c8bfc5ff802 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:42.554368 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-f744e736-83af-413e-a600-1d70b5bb87b4 req-664f2ac2-58b8-4992-a0e4-0c8bfc5ff802 service nova] Creating event network-vif-plugged:a6bccf3e-2937-4ac6-854c-3de5f045836d for instance fec3661d-93ec-46ac-9d30-188e8863b110 on hv-cinder-85069 Jul 21 22:37:42.563707 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-f744e736-83af-413e-a600-1d70b5bb87b4 req-664f2ac2-58b8-4992-a0e4-0c8bfc5ff802 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065644 Jul 21 22:37:42.572802 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 252/549] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:42.580082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-925ae8ad-77a5-427c-8f1b-c2356866c45d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:42.582636 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-925ae8ad-77a5-427c-8f1b-c2356866c45d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:42.603832 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-925ae8ad-77a5-427c-8f1b-c2356866c45d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:42.604572 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-925ae8ad-77a5-427c-8f1b-c2356866c45d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:42.618199 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-925ae8ad-77a5-427c-8f1b-c2356866c45d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:42.618814 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-925ae8ad-77a5-427c-8f1b-c2356866c45d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:42.725984 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-31413028-558b-42c8-bb7c-d1802778f9c2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:42.743621 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-31413028-558b-42c8-bb7c-d1802778f9c2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1367 microversion: 2.1 time: 0.320405 Jul 21 22:37:42.753609 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 298/550] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:42 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:42.780824 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-925ae8ad-77a5-427c-8f1b-c2356866c45d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:42.791079 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-925ae8ad-77a5-427c-8f1b-c2356866c45d tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1307 microversion: 2.1 time: 0.215620 Jul 21 22:37:42.791079 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 253/551] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:42 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1307 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:43.247018 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4a9a1662-7663-47e2-ada7-939e4ec6e792 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:43.250824 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4a9a1662-7663-47e2-ada7-939e4ec6e792 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:43.262137 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4a9a1662-7663-47e2-ada7-939e4ec6e792 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:43.262926 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4a9a1662-7663-47e2-ada7-939e4ec6e792 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:43.264116 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4a9a1662-7663-47e2-ada7-939e4ec6e792 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:43.264922 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4a9a1662-7663-47e2-ada7-939e4ec6e792 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:43.452474 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4a9a1662-7663-47e2-ada7-939e4ec6e792 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:43.462433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4a9a1662-7663-47e2-ada7-939e4ec6e792 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:43.464450 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4a9a1662-7663-47e2-ada7-939e4ec6e792 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:43.465592 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4a9a1662-7663-47e2-ada7-939e4ec6e792 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1407 microversion: 2.20 time: 0.226419 Jul 21 22:37:43.466162 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 299/552] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:43 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:43.770488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-58eab6e0-48f1-4057-ad78-247cec2eb864 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:43.770943 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-58eab6e0-48f1-4057-ad78-247cec2eb864 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:43.777891 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-58eab6e0-48f1-4057-ad78-247cec2eb864 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:43.778342 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-58eab6e0-48f1-4057-ad78-247cec2eb864 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:43.779236 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-58eab6e0-48f1-4057-ad78-247cec2eb864 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:43.779727 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-58eab6e0-48f1-4057-ad78-247cec2eb864 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:43.809192 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-fbd60807-5f63-460f-b11b-82a7088eb28b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:43.810152 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-fbd60807-5f63-460f-b11b-82a7088eb28b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:43.817082 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fbd60807-5f63-460f-b11b-82a7088eb28b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:43.817674 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fbd60807-5f63-460f-b11b-82a7088eb28b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:43.818686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fbd60807-5f63-460f-b11b-82a7088eb28b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:43.819237 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fbd60807-5f63-460f-b11b-82a7088eb28b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:43.995106 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-58eab6e0-48f1-4057-ad78-247cec2eb864 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:44.004381 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-58eab6e0-48f1-4057-ad78-247cec2eb864 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1367 microversion: 2.1 time: 0.238809 Jul 21 22:37:44.005244 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 254/553] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:43 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:44.029060 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-fbd60807-5f63-460f-b11b-82a7088eb28b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:44.037678 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-fbd60807-5f63-460f-b11b-82a7088eb28b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1362 microversion: 2.1 time: 0.232401 Jul 21 22:37:44.038257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 300/554] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:43 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:44.478998 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-7406db2c-a8c7-42b0-ab56-af4114feaf43 req-c93bbdea-11d3-46ba-bcce-a0a467aff940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d750e2e-693a-4313-a846-fbf6c0e646e3", "tag": "dfb50e65-fc1d-4362-ad4b-f3df94db538d"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:44.489375 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4ffe05b0-2bcb-49b9-bba2-fedb73a40176 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:44.489995 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4ffe05b0-2bcb-49b9-bba2-fedb73a40176 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:44.496813 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ffe05b0-2bcb-49b9-bba2-fedb73a40176 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:44.497270 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ffe05b0-2bcb-49b9-bba2-fedb73a40176 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:44.498042 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ffe05b0-2bcb-49b9-bba2-fedb73a40176 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:44.498480 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4ffe05b0-2bcb-49b9-bba2-fedb73a40176 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:44.498608 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-7406db2c-a8c7-42b0-ab56-af4114feaf43 req-c93bbdea-11d3-46ba-bcce-a0a467aff940 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:44.499122 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-7406db2c-a8c7-42b0-ab56-af4114feaf43 req-c93bbdea-11d3-46ba-bcce-a0a467aff940 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:44.512373 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-7406db2c-a8c7-42b0-ab56-af4114feaf43 req-c93bbdea-11d3-46ba-bcce-a0a467aff940 service nova] Creating event network-changed:dfb50e65-fc1d-4362-ad4b-f3df94db538d for instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 on hv-cinder-85069 Jul 21 22:37:44.517484 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-7406db2c-a8c7-42b0-ab56-af4114feaf43 req-c93bbdea-11d3-46ba-bcce-a0a467aff940 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041953 Jul 21 22:37:44.518260 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 255/555] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:44.708214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4ffe05b0-2bcb-49b9-bba2-fedb73a40176 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:44.717049 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4ffe05b0-2bcb-49b9-bba2-fedb73a40176 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:44.718599 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4ffe05b0-2bcb-49b9-bba2-fedb73a40176 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:44.719903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4ffe05b0-2bcb-49b9-bba2-fedb73a40176 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1599 microversion: 2.20 time: 0.235069 Jul 21 22:37:44.720671 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 301/556] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:44 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1599 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:37:44.742825 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f89703a4-906a-4748-a3d6-c299da4f0e15 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:44.742825 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f89703a4-906a-4748-a3d6-c299da4f0e15 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:44.748728 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f89703a4-906a-4748-a3d6-c299da4f0e15 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:44.748728 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f89703a4-906a-4748-a3d6-c299da4f0e15 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:44.749413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f89703a4-906a-4748-a3d6-c299da4f0e15 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:44.749853 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f89703a4-906a-4748-a3d6-c299da4f0e15 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:44.756339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-d010e7f4-a388-4553-a14b-b7bc16e448d1 req-44c3a583-f30b-4feb-91bc-93449858bcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707386e1-842c-43e5-aee3-c9068abc8d02", "name": "network-vif-plugged", "status": "completed", "tag": "3b89f5f0-5c0a-4913-9efe-245565036ad6"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:44.764586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-d010e7f4-a388-4553-a14b-b7bc16e448d1 req-44c3a583-f30b-4feb-91bc-93449858bcf2 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:44.764992 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-d010e7f4-a388-4553-a14b-b7bc16e448d1 req-44c3a583-f30b-4feb-91bc-93449858bcf2 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:44.780998 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-d010e7f4-a388-4553-a14b-b7bc16e448d1 req-44c3a583-f30b-4feb-91bc-93449858bcf2 service nova] Creating event network-vif-plugged:3b89f5f0-5c0a-4913-9efe-245565036ad6 for instance 707386e1-842c-43e5-aee3-c9068abc8d02 on hv-cinder-85069 Jul 21 22:37:44.788013 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-d010e7f4-a388-4553-a14b-b7bc16e448d1 req-44c3a583-f30b-4feb-91bc-93449858bcf2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038930 Jul 21 22:37:44.788985 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 302/557] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:37:44.869911 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f89703a4-906a-4748-a3d6-c299da4f0e15 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.135621 Jul 21 22:37:44.870869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 256/558] 10.222.0.58 () {60 vars in 1315 bytes} [Thu Jul 21 22:37:44 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:37:45.024416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2e8f1b4a-98c6-4ebd-a855-87c40fd0ee8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:45.025511 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2e8f1b4a-98c6-4ebd-a855-87c40fd0ee8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:45.032300 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e8f1b4a-98c6-4ebd-a855-87c40fd0ee8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:45.033093 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e8f1b4a-98c6-4ebd-a855-87c40fd0ee8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:45.033987 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e8f1b4a-98c6-4ebd-a855-87c40fd0ee8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:45.035852 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2e8f1b4a-98c6-4ebd-a855-87c40fd0ee8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:45.040752 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:45.059181 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-219220cb-91bd-4a12-a0a8-f6b26f173c83 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:45.060305 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-219220cb-91bd-4a12-a0a8-f6b26f173c83 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:45.069787 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-219220cb-91bd-4a12-a0a8-f6b26f173c83 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:45.070901 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-219220cb-91bd-4a12-a0a8-f6b26f173c83 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:45.072177 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-219220cb-91bd-4a12-a0a8-f6b26f173c83 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:45.072817 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-219220cb-91bd-4a12-a0a8-f6b26f173c83 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:45.262019 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2e8f1b4a-98c6-4ebd-a855-87c40fd0ee8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:45.270945 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2e8f1b4a-98c6-4ebd-a855-87c40fd0ee8d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1367 microversion: 2.1 time: 0.252492 Jul 21 22:37:45.271730 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 303/559] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:45 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:45.276032 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-219220cb-91bd-4a12-a0a8-f6b26f173c83 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:45.286057 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-219220cb-91bd-4a12-a0a8-f6b26f173c83 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1362 microversion: 2.1 time: 0.233245 Jul 21 22:37:45.286650 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 257/560] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:45 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:45.368636 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f32a4c45-2161-4279-97ec-cfc33162c894 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2093010038"}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:45.369271 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f32a4c45-2161-4279-97ec-cfc33162c894 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:45.375729 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f32a4c45-2161-4279-97ec-cfc33162c894 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:45.376176 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f32a4c45-2161-4279-97ec-cfc33162c894 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:45.376962 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f32a4c45-2161-4279-97ec-cfc33162c894 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:45.377961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f32a4c45-2161-4279-97ec-cfc33162c894 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:45.528369 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.network.security_group_api [None req-f32a4c45-2161-4279-97ec-cfc33162c894 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Removing security group c283507e-3ce2-4081-a122-88cafa5766e5 from port b7065a68-717c-4122-b368-f36d2417f2f0 Jul 21 22:37:45.905546 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f32a4c45-2161-4279-97ec-cfc33162c894 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "POST /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/action" status: 202 len: 0 microversion: 2.1 time: 0.543528 Jul 21 22:37:45.914006 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 304/561] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:37:45 2022] POST /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:37:45.915654 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-3118e373-9436-44e9-b6a7-fe0fb263be33 req-9e604820-fbc6-49c9-b136-255b0505faf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c323b31-2485-44f9-87e9-f2c4e8677f48", "tag": "b7065a68-717c-4122-b368-f36d2417f2f0"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:45.931579 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-3118e373-9436-44e9-b6a7-fe0fb263be33 req-9e604820-fbc6-49c9-b136-255b0505faf4 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:45.932368 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-3118e373-9436-44e9-b6a7-fe0fb263be33 req-9e604820-fbc6-49c9-b136-255b0505faf4 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:45.958843 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-3118e373-9436-44e9-b6a7-fe0fb263be33 req-9e604820-fbc6-49c9-b136-255b0505faf4 service nova] Creating event network-changed:b7065a68-717c-4122-b368-f36d2417f2f0 for instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 on hv-cinder-85069 Jul 21 22:37:45.970630 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-3118e373-9436-44e9-b6a7-fe0fb263be33 req-9e604820-fbc6-49c9-b136-255b0505faf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059114 Jul 21 22:37:45.972415 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 258/562] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:46.288121 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5ffbabcf-8e3f-41ff-a04f-c1c4c032b518 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:46.288741 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-5ffbabcf-8e3f-41ff-a04f-c1c4c032b518 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:46.304443 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5ffbabcf-8e3f-41ff-a04f-c1c4c032b518 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:46.304853 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5ffbabcf-8e3f-41ff-a04f-c1c4c032b518 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:46.305811 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5ffbabcf-8e3f-41ff-a04f-c1c4c032b518 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:46.306407 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-5ffbabcf-8e3f-41ff-a04f-c1c4c032b518 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:46.308903 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4eee282c-eb92-4f3c-8399-0317c2a199a0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:46.310784 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4eee282c-eb92-4f3c-8399-0317c2a199a0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:46.324607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4eee282c-eb92-4f3c-8399-0317c2a199a0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:46.325504 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4eee282c-eb92-4f3c-8399-0317c2a199a0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:46.326991 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4eee282c-eb92-4f3c-8399-0317c2a199a0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:46.339746 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4eee282c-eb92-4f3c-8399-0317c2a199a0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:46.580247 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-5ffbabcf-8e3f-41ff-a04f-c1c4c032b518 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:46.589101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5ffbabcf-8e3f-41ff-a04f-c1c4c032b518 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1367 microversion: 2.1 time: 0.305104 Jul 21 22:37:46.592390 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 305/563] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:46 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:46.600762 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-57a68ade-6ce0-4cf2-8e40-3bf56b9a12ec req-de6d91b8-4f13-49e1-b5a1-71337b23e57c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec3661d-93ec-46ac-9d30-188e8863b110", "tag": "a6bccf3e-2937-4ac6-854c-3de5f045836d"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:46.618741 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-57a68ade-6ce0-4cf2-8e40-3bf56b9a12ec req-de6d91b8-4f13-49e1-b5a1-71337b23e57c service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:46.619189 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-57a68ade-6ce0-4cf2-8e40-3bf56b9a12ec req-de6d91b8-4f13-49e1-b5a1-71337b23e57c service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:46.630062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4eee282c-eb92-4f3c-8399-0317c2a199a0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:46.637437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-57a68ade-6ce0-4cf2-8e40-3bf56b9a12ec req-de6d91b8-4f13-49e1-b5a1-71337b23e57c service nova] Creating event network-changed:a6bccf3e-2937-4ac6-854c-3de5f045836d for instance fec3661d-93ec-46ac-9d30-188e8863b110 on hv-cinder-85069 Jul 21 22:37:46.642579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-57a68ade-6ce0-4cf2-8e40-3bf56b9a12ec req-de6d91b8-4f13-49e1-b5a1-71337b23e57c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048752 Jul 21 22:37:46.643976 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 306/564] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:46.645061 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4eee282c-eb92-4f3c-8399-0317c2a199a0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1362 microversion: 2.1 time: 0.341848 Jul 21 22:37:46.645660 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 259/565] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:46 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:47.550384 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-471c5416-7a4f-4a90-bc09-99272bc8c7c4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:47.550956 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-471c5416-7a4f-4a90-bc09-99272bc8c7c4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:47.557714 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-471c5416-7a4f-4a90-bc09-99272bc8c7c4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:47.558156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-471c5416-7a4f-4a90-bc09-99272bc8c7c4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:47.558913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-471c5416-7a4f-4a90-bc09-99272bc8c7c4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:47.559374 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-471c5416-7a4f-4a90-bc09-99272bc8c7c4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:47.610604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-55f35907-c005-4404-ac46-8aaa59ac680a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:47.611255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-55f35907-c005-4404-ac46-8aaa59ac680a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:47.632614 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-55f35907-c005-4404-ac46-8aaa59ac680a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:47.633068 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-55f35907-c005-4404-ac46-8aaa59ac680a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:47.641305 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-55f35907-c005-4404-ac46-8aaa59ac680a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:47.641800 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-55f35907-c005-4404-ac46-8aaa59ac680a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:47.854976 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-471c5416-7a4f-4a90-bc09-99272bc8c7c4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lazy-loading 'services' on Instance uuid 0c323b31-2485-44f9-87e9-f2c4e8677f48 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:37:47.956161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-471c5416-7a4f-4a90-bc09-99272bc8c7c4 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/os-volume_attachments/db73042f-3f49-46ba-8578-e80f5ab997f0" status: 202 len: 0 microversion: 2.1 time: 0.410150 Jul 21 22:37:47.956952 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 307/566] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:37:47 2022] DELETE /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/os-volume_attachments/db73042f-3f49-46ba-8578-e80f5ab997f0 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:37:47.963399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f9333358-65cc-4d3e-adb1-3e3965285011 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:47.965201 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f9333358-65cc-4d3e-adb1-3e3965285011 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:47.975570 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9333358-65cc-4d3e-adb1-3e3965285011 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:47.978474 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9333358-65cc-4d3e-adb1-3e3965285011 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:47.979991 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9333358-65cc-4d3e-adb1-3e3965285011 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:47.981538 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f9333358-65cc-4d3e-adb1-3e3965285011 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:47.996268 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-55f35907-c005-4404-ac46-8aaa59ac680a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:48.018056 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-55f35907-c005-4404-ac46-8aaa59ac680a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1557 microversion: 2.1 time: 0.411922 Jul 21 22:37:48.022983 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 260/567] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:47 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1557 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:48.029413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0acf4586-83d5-4f2a-8509-3922ac520c63 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:48.030555 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0acf4586-83d5-4f2a-8509-3922ac520c63 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:48.040951 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0acf4586-83d5-4f2a-8509-3922ac520c63 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:48.041703 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0acf4586-83d5-4f2a-8509-3922ac520c63 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:48.054786 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0acf4586-83d5-4f2a-8509-3922ac520c63 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:48.055279 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0acf4586-83d5-4f2a-8509-3922ac520c63 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:48.168106 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f9333358-65cc-4d3e-adb1-3e3965285011 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:48.169921 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0acf4586-83d5-4f2a-8509-3922ac520c63 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145392 Jul 21 22:37:48.173318 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 261/568] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:37:48 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:48.177616 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f9333358-65cc-4d3e-adb1-3e3965285011 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1362 microversion: 2.1 time: 0.218473 Jul 21 22:37:48.178448 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 308/569] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:47 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:48.192660 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3e966e12-0cf0-44ca-bc90-f405defb4c9d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:48.193245 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3e966e12-0cf0-44ca-bc90-f405defb4c9d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:48.199671 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3e966e12-0cf0-44ca-bc90-f405defb4c9d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:48.200125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3e966e12-0cf0-44ca-bc90-f405defb4c9d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:48.200908 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3e966e12-0cf0-44ca-bc90-f405defb4c9d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:48.201342 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3e966e12-0cf0-44ca-bc90-f405defb4c9d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:48.283461 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3e966e12-0cf0-44ca-bc90-f405defb4c9d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104488 Jul 21 22:37:48.285364 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 262/570] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 22:37:48 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:48.686204 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-ca6f1f25-61c4-4664-ba9a-2be23e7feea8 req-4f56a604-ad61-43d1-8586-a7d41ffc41f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c323b31-2485-44f9-87e9-f2c4e8677f48", "tag": "b7065a68-717c-4122-b368-f36d2417f2f0"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:48.696191 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-ca6f1f25-61c4-4664-ba9a-2be23e7feea8 req-4f56a604-ad61-43d1-8586-a7d41ffc41f9 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:48.696976 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-ca6f1f25-61c4-4664-ba9a-2be23e7feea8 req-4f56a604-ad61-43d1-8586-a7d41ffc41f9 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:48.710358 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-ca6f1f25-61c4-4664-ba9a-2be23e7feea8 req-4f56a604-ad61-43d1-8586-a7d41ffc41f9 service nova] Creating event network-changed:b7065a68-717c-4122-b368-f36d2417f2f0 for instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 on hv-cinder-85069 Jul 21 22:37:48.715718 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-ca6f1f25-61c4-4664-ba9a-2be23e7feea8 req-4f56a604-ad61-43d1-8586-a7d41ffc41f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033159 Jul 21 22:37:48.716991 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 309/571] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:49.186060 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b5b4fb98-4d85-49e5-9fd6-630000580b53 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:49.186986 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b5b4fb98-4d85-49e5-9fd6-630000580b53 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:49.195784 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5b4fb98-4d85-49e5-9fd6-630000580b53 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:49.196526 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5b4fb98-4d85-49e5-9fd6-630000580b53 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:49.197477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5b4fb98-4d85-49e5-9fd6-630000580b53 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:49.198066 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5b4fb98-4d85-49e5-9fd6-630000580b53 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:49.206955 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-abe3ed61-15b9-4220-9814-b4f386108cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:49.211759 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-abe3ed61-15b9-4220-9814-b4f386108cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:49.218411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-abe3ed61-15b9-4220-9814-b4f386108cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:49.219365 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-abe3ed61-15b9-4220-9814-b4f386108cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:49.220289 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-abe3ed61-15b9-4220-9814-b4f386108cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:49.220869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-abe3ed61-15b9-4220-9814-b4f386108cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:49.244812 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b5b4fb98-4d85-49e5-9fd6-630000580b53 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063101 Jul 21 22:37:49.245680 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 263/572] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:37:49 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:37:49.256446 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9e136242-f775-46be-b658-ada5c3bfbbe3 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:49.257169 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-9e136242-f775-46be-b658-ada5c3bfbbe3 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:49.264813 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9e136242-f775-46be-b658-ada5c3bfbbe3 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:49.265510 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9e136242-f775-46be-b658-ada5c3bfbbe3 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:49.266643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9e136242-f775-46be-b658-ada5c3bfbbe3 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:49.267552 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9e136242-f775-46be-b658-ada5c3bfbbe3 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:49.373319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-abe3ed61-15b9-4220-9814-b4f386108cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:49.382135 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-abe3ed61-15b9-4220-9814-b4f386108cb9 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1362 microversion: 2.1 time: 0.189367 Jul 21 22:37:49.382920 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 310/573] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:49 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:49.411778 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-9e136242-f775-46be-b658-ada5c3bfbbe3 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] HTTP exception thrown: Instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 is not attached to volume db73042f-3f49-46ba-8578-e80f5ab997f0 Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9e136242-f775-46be-b658-ada5c3bfbbe3 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Request method failure captured: Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: DELETE /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/os-volume_attachments/db73042f-3f49-46ba-8578-e80f5ab997f0 HTTP/1.1 Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dScLrTdDfeeG0CUN-Z2fotyM7M3nssZts_J9Kg8_ZrQIPpclLqlG7OpTva7RrnXXj8u-dPvgekXwacSqJ1NVSLCR6qmIPICVTl2TgDjDtq6E5B5qia7ZxWn-_L_ZoirmtZmHQ4qHlfy-kSZvflmHWOriZk3xSWeVBFJ20q8NZmvi6M Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 7a302ecda6ca4e778fadc4d9dcbef1e2 Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-TestMinimumBasicScenario-1643871520 Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:37:49.414173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:37:49.415664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a302ecda6ca4e778fadc4d9dcbef1e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a302ecda6ca4e778fadc4d9dcbef1e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7a302ecda6ca4e778fadc4d9dcbef1e2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7a302ecda6ca4e778fadc4d9dcbef1e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:37:49.415664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-TestMinimumBasicScenario-1643871520 Jul 21 22:37:49.415664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 7a302ecda6ca4e778fadc4d9dcbef1e2 Jul 21 22:37:49.415664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1643871520 Jul 21 22:37:49.415664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-TestMinimumBasicScenario-1643871520-project Jul 21 22:37:49.415664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:37:49.415664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:37:49.415664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 13dbb228e1c846f48d37b43be84045f9 Jul 21 22:37:49.415664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-TestMinimumBasicScenario-1643871520-project Jul 21 22:37:49.415664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:37:49.415664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 is not attached to volume db73042f-3f49-46ba-8578-e80f5ab997f0 Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'server_id': '0c323b31-2485-44f9-87e9-f2c4e8677f48', 'id': 'db73042f-3f49-46ba-8578-e80f5ab997f0'} Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id db73042f-3f49-46ba-8578-e80f5ab997f0. Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:37:49.416371 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 is not attached to volume db73042f-3f49-46ba-8578-e80f5ab997f0 Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 is not attached to volume db73042f-3f49-46ba-8578-e80f5ab997f0 Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:49.417582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9e136242-f775-46be-b658-ada5c3bfbbe3 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Returning 404 to user: Instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 is not attached to volume db73042f-3f49-46ba-8578-e80f5ab997f0 {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:37:49.418450 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-9e136242-f775-46be-b658-ada5c3bfbbe3 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/os-volume_attachments/db73042f-3f49-46ba-8578-e80f5ab997f0" status: 404 len: 154 microversion: 2.1 time: 0.164087 Jul 21 22:37:49.418450 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 264/574] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:37:49 2022] DELETE /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48/os-volume_attachments/db73042f-3f49-46ba-8578-e80f5ab997f0 => generated 154 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:37:50.400487 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-13227900-5899-4ddb-a729-8d96ec497131 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:50.401324 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-13227900-5899-4ddb-a729-8d96ec497131 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:50.407575 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-13227900-5899-4ddb-a729-8d96ec497131 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:50.408020 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-13227900-5899-4ddb-a729-8d96ec497131 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:50.409441 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-13227900-5899-4ddb-a729-8d96ec497131 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:50.410438 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-13227900-5899-4ddb-a729-8d96ec497131 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:50.571352 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-13227900-5899-4ddb-a729-8d96ec497131 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:50.581376 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-13227900-5899-4ddb-a729-8d96ec497131 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1362 microversion: 2.1 time: 0.183999 Jul 21 22:37:50.581848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-377e480c-ac19-4ce1-a8eb-ed62fd5e60ab tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:50.582313 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 311/575] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:50 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:50.582904 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-377e480c-ac19-4ce1-a8eb-ed62fd5e60ab tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:50.595338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-377e480c-ac19-4ce1-a8eb-ed62fd5e60ab tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:50.596261 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-377e480c-ac19-4ce1-a8eb-ed62fd5e60ab tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:50.597020 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-377e480c-ac19-4ce1-a8eb-ed62fd5e60ab tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:50.597495 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-377e480c-ac19-4ce1-a8eb-ed62fd5e60ab tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:50.625906 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-377e480c-ac19-4ce1-a8eb-ed62fd5e60ab tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:37:50.630220 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=100 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:50.724038 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-377e480c-ac19-4ce1-a8eb-ed62fd5e60ab tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 204 len: 0 microversion: 2.1 time: 0.150687 Jul 21 22:37:50.726321 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 265/576] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:37:50 2022] DELETE /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:37:50.734663 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9408c8ad-d032-4942-8a5f-7afd97c12ad7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:50.736285 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-9408c8ad-d032-4942-8a5f-7afd97c12ad7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:50.744461 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-c54286dc-948f-4d0c-a53a-122e57d7a5aa req-d99e94d5-4ad6-4795-b657-36b6534e8395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707386e1-842c-43e5-aee3-c9068abc8d02", "tag": "3b89f5f0-5c0a-4913-9efe-245565036ad6"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:50.746864 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9408c8ad-d032-4942-8a5f-7afd97c12ad7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:50.747648 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9408c8ad-d032-4942-8a5f-7afd97c12ad7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:50.749426 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9408c8ad-d032-4942-8a5f-7afd97c12ad7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:50.750071 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9408c8ad-d032-4942-8a5f-7afd97c12ad7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:50.753639 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-c54286dc-948f-4d0c-a53a-122e57d7a5aa req-d99e94d5-4ad6-4795-b657-36b6534e8395 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:50.753975 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-c54286dc-948f-4d0c-a53a-122e57d7a5aa req-d99e94d5-4ad6-4795-b657-36b6534e8395 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:50.773383 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-c54286dc-948f-4d0c-a53a-122e57d7a5aa req-d99e94d5-4ad6-4795-b657-36b6534e8395 service nova] Creating event network-changed:3b89f5f0-5c0a-4913-9efe-245565036ad6 for instance 707386e1-842c-43e5-aee3-c9068abc8d02 on hv-cinder-85069 Jul 21 22:37:50.779600 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-c54286dc-948f-4d0c-a53a-122e57d7a5aa req-d99e94d5-4ad6-4795-b657-36b6534e8395 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039482 Jul 21 22:37:50.780446 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 266/577] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:50.931772 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-9408c8ad-d032-4942-8a5f-7afd97c12ad7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:50.939800 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-9408c8ad-d032-4942-8a5f-7afd97c12ad7 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1554 microversion: 2.1 time: 0.209078 Jul 21 22:37:50.940896 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 312/578] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:50 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:51.596821 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=6 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:51.597598 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=22 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:51.602070 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1ceb5657-9156-4496-9e05-10e9b6e6c41a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:51.602760 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1ceb5657-9156-4496-9e05-10e9b6e6c41a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:51.609869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ceb5657-9156-4496-9e05-10e9b6e6c41a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:51.610320 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ceb5657-9156-4496-9e05-10e9b6e6c41a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:51.611124 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ceb5657-9156-4496-9e05-10e9b6e6c41a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:51.612250 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ceb5657-9156-4496-9e05-10e9b6e6c41a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:51.744903 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1ceb5657-9156-4496-9e05-10e9b6e6c41a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:51.753905 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1ceb5657-9156-4496-9e05-10e9b6e6c41a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1362 microversion: 2.1 time: 0.158648 Jul 21 22:37:51.754486 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 267/579] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:51 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:51.959000 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3eece5db-80ae-43b1-bf08-24b0581177a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:51.959652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3eece5db-80ae-43b1-bf08-24b0581177a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:51.961695 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=14 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:51.967643 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3eece5db-80ae-43b1-bf08-24b0581177a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:51.968099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3eece5db-80ae-43b1-bf08-24b0581177a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:51.968888 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3eece5db-80ae-43b1-bf08-24b0581177a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:51.969322 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3eece5db-80ae-43b1-bf08-24b0581177a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:52.106711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3eece5db-80ae-43b1-bf08-24b0581177a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:52.115309 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3eece5db-80ae-43b1-bf08-24b0581177a8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1554 microversion: 2.1 time: 0.161674 Jul 21 22:37:52.115887 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 313/580] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:51 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:52.216152 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-1ca5e80e-db24-46fd-8676-bc40f32e1796 req-e83581bf-44be-4380-ad2c-2a5a6dacc7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d750e2e-693a-4313-a846-fbf6c0e646e3", "name": "network-vif-plugged", "status": "completed", "tag": "dfb50e65-fc1d-4362-ad4b-f3df94db538d"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:52.225070 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-1ca5e80e-db24-46fd-8676-bc40f32e1796 req-e83581bf-44be-4380-ad2c-2a5a6dacc7e0 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:52.225510 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-1ca5e80e-db24-46fd-8676-bc40f32e1796 req-e83581bf-44be-4380-ad2c-2a5a6dacc7e0 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:52.239409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-1ca5e80e-db24-46fd-8676-bc40f32e1796 req-e83581bf-44be-4380-ad2c-2a5a6dacc7e0 service nova] Creating event network-vif-plugged:dfb50e65-fc1d-4362-ad4b-f3df94db538d for instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 on hv-cinder-85069 Jul 21 22:37:52.244115 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-1ca5e80e-db24-46fd-8676-bc40f32e1796 req-e83581bf-44be-4380-ad2c-2a5a6dacc7e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031869 Jul 21 22:37:52.244710 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 268/581] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:37:52.771484 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-38353a59-bf4b-46ed-b823-560e0d4296ce tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:52.772110 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-38353a59-bf4b-46ed-b823-560e0d4296ce tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:52.778069 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-38353a59-bf4b-46ed-b823-560e0d4296ce tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:52.778518 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-38353a59-bf4b-46ed-b823-560e0d4296ce tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:52.779306 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-38353a59-bf4b-46ed-b823-560e0d4296ce tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:52.780082 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-38353a59-bf4b-46ed-b823-560e0d4296ce tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:52.910739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-38353a59-bf4b-46ed-b823-560e0d4296ce tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:52.920494 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-38353a59-bf4b-46ed-b823-560e0d4296ce tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1362 microversion: 2.1 time: 0.153636 Jul 21 22:37:52.921269 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 314/582] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:52 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:53.133265 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d6229cec-861a-4cad-ab43-24a5a81a06e0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:53.133987 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d6229cec-861a-4cad-ab43-24a5a81a06e0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:53.140208 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d6229cec-861a-4cad-ab43-24a5a81a06e0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:53.140655 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d6229cec-861a-4cad-ab43-24a5a81a06e0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:53.141418 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d6229cec-861a-4cad-ab43-24a5a81a06e0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:53.141857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d6229cec-861a-4cad-ab43-24a5a81a06e0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:53.286824 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d6229cec-861a-4cad-ab43-24a5a81a06e0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:53.294688 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d6229cec-861a-4cad-ab43-24a5a81a06e0 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1554 microversion: 2.1 time: 0.166047 Jul 21 22:37:53.295324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 269/583] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:53 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:53.921652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-ad512575-6da0-490d-8c0a-066d3cb2d055 req-ed572318-504c-44fd-a303-94a6a4b1d230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c323b31-2485-44f9-87e9-f2c4e8677f48", "name": "network-vif-deleted", "tag": "b7065a68-717c-4122-b368-f36d2417f2f0"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:53.935165 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-ad512575-6da0-490d-8c0a-066d3cb2d055 req-ed572318-504c-44fd-a303-94a6a4b1d230 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:53.935882 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-ad512575-6da0-490d-8c0a-066d3cb2d055 req-ed572318-504c-44fd-a303-94a6a4b1d230 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:53.941702 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c5029840-8dbf-4a72-9f36-9b7ff772ba27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:53.942459 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c5029840-8dbf-4a72-9f36-9b7ff772ba27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:53.949533 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c5029840-8dbf-4a72-9f36-9b7ff772ba27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:53.950087 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c5029840-8dbf-4a72-9f36-9b7ff772ba27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:53.950746 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-ad512575-6da0-490d-8c0a-066d3cb2d055 req-ed572318-504c-44fd-a303-94a6a4b1d230 service nova] Creating event network-vif-deleted:b7065a68-717c-4122-b368-f36d2417f2f0 for instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 on hv-cinder-85069 Jul 21 22:37:53.951000 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c5029840-8dbf-4a72-9f36-9b7ff772ba27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:53.951737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c5029840-8dbf-4a72-9f36-9b7ff772ba27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:53.956152 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-ad512575-6da0-490d-8c0a-066d3cb2d055 req-ed572318-504c-44fd-a303-94a6a4b1d230 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038960 Jul 21 22:37:53.956755 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 315/584] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:37:54.098245 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c5029840-8dbf-4a72-9f36-9b7ff772ba27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:54.106175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c5029840-8dbf-4a72-9f36-9b7ff772ba27 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1362 microversion: 2.1 time: 0.171992 Jul 21 22:37:54.106759 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 270/585] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:53 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:54.313273 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-58dca5c7-f363-4979-a2ce-d59e71e4278b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:54.313970 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-58dca5c7-f363-4979-a2ce-d59e71e4278b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:54.321168 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-58dca5c7-f363-4979-a2ce-d59e71e4278b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:54.321599 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-58dca5c7-f363-4979-a2ce-d59e71e4278b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:54.322366 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-58dca5c7-f363-4979-a2ce-d59e71e4278b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:54.322794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-58dca5c7-f363-4979-a2ce-d59e71e4278b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:54.355620 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-58dca5c7-f363-4979-a2ce-d59e71e4278b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:54.356053 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-58dca5c7-f363-4979-a2ce-d59e71e4278b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:54.356492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-58dca5c7-f363-4979-a2ce-d59e71e4278b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lazy-loading 'fault' on Instance uuid 0c323b31-2485-44f9-87e9-f2c4e8677f48 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:37:54.398555 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-58dca5c7-f363-4979-a2ce-d59e71e4278b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13dbb228e1c846f48d37b43be84045f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a302ecda6ca4e778fadc4d9dcbef1e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:54.406072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-58dca5c7-f363-4979-a2ce-d59e71e4278b tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 200 len: 1348 microversion: 2.1 time: 0.097387 Jul 21 22:37:54.406671 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 316/586] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:54 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:55.126805 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7390dcdc-16e7-4de9-bb39-7ea113fc14bf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:55.127925 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7390dcdc-16e7-4de9-bb39-7ea113fc14bf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:55.134487 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7390dcdc-16e7-4de9-bb39-7ea113fc14bf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:55.134935 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7390dcdc-16e7-4de9-bb39-7ea113fc14bf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:55.135752 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7390dcdc-16e7-4de9-bb39-7ea113fc14bf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:55.136184 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7390dcdc-16e7-4de9-bb39-7ea113fc14bf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:55.279225 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7390dcdc-16e7-4de9-bb39-7ea113fc14bf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:55.287673 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7390dcdc-16e7-4de9-bb39-7ea113fc14bf tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1548 microversion: 2.1 time: 0.164725 Jul 21 22:37:55.288256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 271/587] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:55 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:55.304912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b89fa29e-c1b6-4289-aefb-339a8263094c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:55.305454 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b89fa29e-c1b6-4289-aefb-339a8263094c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:55.311531 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b89fa29e-c1b6-4289-aefb-339a8263094c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:55.312069 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b89fa29e-c1b6-4289-aefb-339a8263094c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:55.312845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b89fa29e-c1b6-4289-aefb-339a8263094c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:55.313274 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b89fa29e-c1b6-4289-aefb-339a8263094c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:55.395820 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b89fa29e-c1b6-4289-aefb-339a8263094c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094835 Jul 21 22:37:55.396451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 317/588] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 22:37:55 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:55.424766 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c221046a-f5dd-4362-9bf9-5d13cbebbfaf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:55.425472 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c221046a-f5dd-4362-9bf9-5d13cbebbfaf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] [instance: 0c323b31-2485-44f9-87e9-f2c4e8677f48] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:55.431854 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c221046a-f5dd-4362-9bf9-5d13cbebbfaf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:55.432334 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c221046a-f5dd-4362-9bf9-5d13cbebbfaf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:55.433118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c221046a-f5dd-4362-9bf9-5d13cbebbfaf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:55.433555 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c221046a-f5dd-4362-9bf9-5d13cbebbfaf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:55.449137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-c221046a-f5dd-4362-9bf9-5d13cbebbfaf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] HTTP exception thrown: Instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 could not be found. Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c221046a-f5dd-4362-9bf9-5d13cbebbfaf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Request method failure captured: Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 HTTP/1.1 Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dScLrTdDfeeG0CUN-Z2fotyM7M3nssZts_J9Kg8_ZrQIPpclLqlG7OpTva7RrnXXj8u-dPvgekXwacSqJ1NVSLCR6qmIPICVTl2TgDjDtq6E5B5qia7ZxWn-_L_ZoirmtZmHQ4qHlfy-kSZvflmHWOriZk3xSWeVBFJ20q8NZmvi6M Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 7a302ecda6ca4e778fadc4d9dcbef1e2 Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-TestMinimumBasicScenario-1643871520 Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:37:55.450990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a302ecda6ca4e778fadc4d9dcbef1e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a302ecda6ca4e778fadc4d9dcbef1e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7a302ecda6ca4e778fadc4d9dcbef1e2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7a302ecda6ca4e778fadc4d9dcbef1e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-TestMinimumBasicScenario-1643871520 Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 7a302ecda6ca4e778fadc4d9dcbef1e2 Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1643871520 Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-TestMinimumBasicScenario-1643871520-project Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 13dbb228e1c846f48d37b43be84045f9 Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-TestMinimumBasicScenario-1643871520-project Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 could not be found. Jul 21 22:37:55.452356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': '0c323b31-2485-44f9-87e9-f2c4e8677f48'} Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 could not be found. Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:37:55.453062 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 could not be found. Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 could not be found. Jul 21 22:37:55.454273 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:37:55.456091 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c221046a-f5dd-4362-9bf9-5d13cbebbfaf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Returning 404 to user: Instance 0c323b31-2485-44f9-87e9-f2c4e8677f48 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:37:55.456091 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c221046a-f5dd-4362-9bf9-5d13cbebbfaf tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48" status: 404 len: 111 microversion: 2.1 time: 0.032462 Jul 21 22:37:55.456091 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 272/589] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:55 2022] GET /compute/v2.1/servers/0c323b31-2485-44f9-87e9-f2c4e8677f48 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:37:55.462157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ff00c087-3b28-4f1a-8b9b-adad898e2ff8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] Calling method '.version_select at 0x7f47e69b9b80>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:55.482777 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ff00c087-3b28-4f1a-8b9b-adad898e2ff8 tempest-TestMinimumBasicScenario-1643871520 tempest-TestMinimumBasicScenario-1643871520-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1156859559" status: 202 len: 0 microversion: 2.1 time: 0.024491 Jul 21 22:37:55.483644 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 318/590] 10.222.0.58 () {58 vars in 1271 bytes} [Thu Jul 21 22:37:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1156859559 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:37:56.674749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-1493f956-1ab6-45ab-aec5-50cc3bfb0c41 req-41d5f12b-22cd-4523-82c8-28e9ae6aeee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d750e2e-693a-4313-a846-fbf6c0e646e3", "tag": "dfb50e65-fc1d-4362-ad4b-f3df94db538d"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:56.691293 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-1493f956-1ab6-45ab-aec5-50cc3bfb0c41 req-41d5f12b-22cd-4523-82c8-28e9ae6aeee9 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:56.691888 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-1493f956-1ab6-45ab-aec5-50cc3bfb0c41 req-41d5f12b-22cd-4523-82c8-28e9ae6aeee9 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:56.704046 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-1493f956-1ab6-45ab-aec5-50cc3bfb0c41 req-41d5f12b-22cd-4523-82c8-28e9ae6aeee9 service nova] Creating event network-changed:dfb50e65-fc1d-4362-ad4b-f3df94db538d for instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 on hv-cinder-85069 Jul 21 22:37:56.709768 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-1493f956-1ab6-45ab-aec5-50cc3bfb0c41 req-41d5f12b-22cd-4523-82c8-28e9ae6aeee9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038622 Jul 21 22:37:56.710489 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 273/591] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:58.447210 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ee3c76e4-09db-4cbb-890c-c75325fc32f8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:58.447785 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ee3c76e4-09db-4cbb-890c-c75325fc32f8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:58.456609 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee3c76e4-09db-4cbb-890c-c75325fc32f8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:58.457168 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee3c76e4-09db-4cbb-890c-c75325fc32f8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:58.458021 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee3c76e4-09db-4cbb-890c-c75325fc32f8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:58.458523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ee3c76e4-09db-4cbb-890c-c75325fc32f8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:58.558341 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-ee3c76e4-09db-4cbb-890c-c75325fc32f8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lazy-loading 'services' on Instance uuid c214c984-d0d9-4920-882c-6b481647edc5 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:37:58.650703 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ee3c76e4-09db-4cbb-890c-c75325fc32f8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-volume_attachments/f00bc401-e488-458b-9825-157831fb1bea" status: 202 len: 0 microversion: 2.1 time: 0.207485 Jul 21 22:37:58.652117 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 319/592] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:37:58 2022] DELETE /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-volume_attachments/f00bc401-e488-458b-9825-157831fb1bea => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:37:58.666082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-831e3609-8218-46a4-ad11-57eca6d4ac40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:58.668258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-831e3609-8218-46a4-ad11-57eca6d4ac40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:58.687775 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-831e3609-8218-46a4-ad11-57eca6d4ac40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:58.688571 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-831e3609-8218-46a4-ad11-57eca6d4ac40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:58.690091 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-831e3609-8218-46a4-ad11-57eca6d4ac40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:58.691336 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-831e3609-8218-46a4-ad11-57eca6d4ac40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:58.741480 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-831e3609-8218-46a4-ad11-57eca6d4ac40 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084150 Jul 21 22:37:58.742350 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 274/593] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:37:58 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:37:59.769281 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8db3522e-2ad5-48a5-995c-44626477c009 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:59.771381 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8db3522e-2ad5-48a5-995c-44626477c009 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:59.792725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8db3522e-2ad5-48a5-995c-44626477c009 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:59.794261 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8db3522e-2ad5-48a5-995c-44626477c009 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:59.796184 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8db3522e-2ad5-48a5-995c-44626477c009 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:59.797179 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8db3522e-2ad5-48a5-995c-44626477c009 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:59.866930 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8db3522e-2ad5-48a5-995c-44626477c009 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116567 Jul 21 22:37:59.868452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 320/594] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:37:59 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:37:59.978858 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f1268a08-8ca7-4f38-94c5-d6c0f27ba158 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:59.980209 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f1268a08-8ca7-4f38-94c5-d6c0f27ba158 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:59.991807 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1268a08-8ca7-4f38-94c5-d6c0f27ba158 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:59.993565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1268a08-8ca7-4f38-94c5-d6c0f27ba158 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:59.995365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1268a08-8ca7-4f38-94c5-d6c0f27ba158 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:59.996464 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1268a08-8ca7-4f38-94c5-d6c0f27ba158 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:00.036616 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f1268a08-8ca7-4f38-94c5-d6c0f27ba158 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:38:00.187116 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f1268a08-8ca7-4f38-94c5-d6c0f27ba158 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 204 len: 0 microversion: 2.1 time: 0.212076 Jul 21 22:38:00.188609 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 275/595] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:37:59 2022] DELETE /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:38:00.201933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2aa168d9-22da-4e39-9e1d-6150631615ed tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:00.202786 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2aa168d9-22da-4e39-9e1d-6150631615ed tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:00.215273 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2aa168d9-22da-4e39-9e1d-6150631615ed tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:00.216089 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2aa168d9-22da-4e39-9e1d-6150631615ed tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:00.217494 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2aa168d9-22da-4e39-9e1d-6150631615ed tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:00.218263 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2aa168d9-22da-4e39-9e1d-6150631615ed tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:00.555802 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2aa168d9-22da-4e39-9e1d-6150631615ed tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:00.559373 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:00.565567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2aa168d9-22da-4e39-9e1d-6150631615ed tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1690 microversion: 2.1 time: 0.371281 Jul 21 22:38:00.566087 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 321/596] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:00 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1690 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:01.587582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-475f8a32-c3ff-4e23-b9d7-6325560f96df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:01.588634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-475f8a32-c3ff-4e23-b9d7-6325560f96df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:01.592950 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:01.601931 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-475f8a32-c3ff-4e23-b9d7-6325560f96df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:01.602692 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-475f8a32-c3ff-4e23-b9d7-6325560f96df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:01.604107 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-475f8a32-c3ff-4e23-b9d7-6325560f96df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:01.604860 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-475f8a32-c3ff-4e23-b9d7-6325560f96df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:01.977636 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-475f8a32-c3ff-4e23-b9d7-6325560f96df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:01.987601 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-475f8a32-c3ff-4e23-b9d7-6325560f96df tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1690 microversion: 2.1 time: 0.408201 Jul 21 22:38:01.988341 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 276/597] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:01 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1690 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:03.008188 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d4b517e5-23ab-47f0-a924-d69d7f6c4d2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:03.008787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d4b517e5-23ab-47f0-a924-d69d7f6c4d2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:03.016237 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d4b517e5-23ab-47f0-a924-d69d7f6c4d2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:03.016683 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d4b517e5-23ab-47f0-a924-d69d7f6c4d2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:03.018256 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d4b517e5-23ab-47f0-a924-d69d7f6c4d2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:03.018854 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d4b517e5-23ab-47f0-a924-d69d7f6c4d2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:03.484040 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d4b517e5-23ab-47f0-a924-d69d7f6c4d2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:03.492847 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d4b517e5-23ab-47f0-a924-d69d7f6c4d2b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1690 microversion: 2.1 time: 0.489382 Jul 21 22:38:03.499517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 322/598] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:03 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1690 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:04.517198 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-35393d77-5fa6-4554-925f-d80da964dd3d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:04.518023 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-35393d77-5fa6-4554-925f-d80da964dd3d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:04.525692 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-35393d77-5fa6-4554-925f-d80da964dd3d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:04.526252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-35393d77-5fa6-4554-925f-d80da964dd3d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:04.527614 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-35393d77-5fa6-4554-925f-d80da964dd3d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:04.528453 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-35393d77-5fa6-4554-925f-d80da964dd3d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:04.692811 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-35393d77-5fa6-4554-925f-d80da964dd3d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:04.707568 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-35393d77-5fa6-4554-925f-d80da964dd3d tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1690 microversion: 2.1 time: 0.194831 Jul 21 22:38:04.719830 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 277/599] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:04 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1690 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:05.336827 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-45f8f825-41b9-4a7d-87da-d4662c5a98be req-e1707350-666b-4391-b3d3-2ebedd433524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c214c984-d0d9-4920-882c-6b481647edc5", "name": "network-vif-deleted", "tag": "2474b6a6-f120-434b-bba6-8abb5364b833"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:05.346622 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:05.366586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-45f8f825-41b9-4a7d-87da-d4662c5a98be req-e1707350-666b-4391-b3d3-2ebedd433524 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:05.367039 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-45f8f825-41b9-4a7d-87da-d4662c5a98be req-e1707350-666b-4391-b3d3-2ebedd433524 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:05.383915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-45f8f825-41b9-4a7d-87da-d4662c5a98be req-e1707350-666b-4391-b3d3-2ebedd433524 service nova] Creating event network-vif-deleted:2474b6a6-f120-434b-bba6-8abb5364b833 for instance c214c984-d0d9-4920-882c-6b481647edc5 on hv-cinder-85069 Jul 21 22:38:05.395494 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-45f8f825-41b9-4a7d-87da-d4662c5a98be req-e1707350-666b-4391-b3d3-2ebedd433524 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062153 Jul 21 22:38:05.403206 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 323/600] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:05.728267 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e98fb6b5-d84b-4f7e-a1cc-a62a2724dfca tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:05.733175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e98fb6b5-d84b-4f7e-a1cc-a62a2724dfca tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:05.749513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e98fb6b5-d84b-4f7e-a1cc-a62a2724dfca tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:05.751368 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e98fb6b5-d84b-4f7e-a1cc-a62a2724dfca tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:05.753753 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e98fb6b5-d84b-4f7e-a1cc-a62a2724dfca tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:05.754977 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e98fb6b5-d84b-4f7e-a1cc-a62a2724dfca tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:05.815549 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e98fb6b5-d84b-4f7e-a1cc-a62a2724dfca tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:05.816076 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e98fb6b5-d84b-4f7e-a1cc-a62a2724dfca tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:05.817125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-e98fb6b5-d84b-4f7e-a1cc-a62a2724dfca tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lazy-loading 'fault' on Instance uuid c214c984-d0d9-4920-882c-6b481647edc5 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:38:05.869228 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e98fb6b5-d84b-4f7e-a1cc-a62a2724dfca tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:05.882029 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e98fb6b5-d84b-4f7e-a1cc-a62a2724dfca tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 200 len: 1335 microversion: 2.1 time: 0.157574 Jul 21 22:38:05.883748 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 278/601] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:05 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 1335 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:06.900029 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0996cbb6-e101-4e0a-9bc8-4046d477809b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:06.900725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0996cbb6-e101-4e0a-9bc8-4046d477809b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: c214c984-d0d9-4920-882c-6b481647edc5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:06.907704 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0996cbb6-e101-4e0a-9bc8-4046d477809b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:06.908191 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0996cbb6-e101-4e0a-9bc8-4046d477809b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:06.908970 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0996cbb6-e101-4e0a-9bc8-4046d477809b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:06.909406 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0996cbb6-e101-4e0a-9bc8-4046d477809b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:06.925037 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-0996cbb6-e101-4e0a-9bc8-4046d477809b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] HTTP exception thrown: Instance c214c984-d0d9-4920-882c-6b481647edc5 could not be found. Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0996cbb6-e101-4e0a-9bc8-4046d477809b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Request method failure captured: Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 HTTP/1.1 Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQcy_G8ocjTOCjKfuQiJgav55FcHkpRzXV2eQjXzWDayGJS8w3BYSyBfL-Cs1UDOIt1B3j3O6nqOG9p2BeXrgzNDFMGpTB6FKm7m_uSZW9Uo2VLu24MyVG3Pb1Z8P536qLitexREcsNaSkF2h16ltZ1uA89QIYJo0KijJzLAxeNAN0 Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 3138cf3bb8a24ba19295565fca0a471e Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:38:06.926709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3138cf3bb8a24ba19295565fca0a471e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 3138cf3bb8a24ba19295565fca0a471e Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-ServerRescueNegativeTestJSON-1702913491-project Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: cf3fd4428e3b46cd9e83e1d32571097b Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1702913491-project Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance c214c984-d0d9-4920-882c-6b481647edc5 could not be found. Jul 21 22:38:06.928413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'c214c984-d0d9-4920-882c-6b481647edc5'} Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c214c984-d0d9-4920-882c-6b481647edc5 could not be found. Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:38:06.932706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c214c984-d0d9-4920-882c-6b481647edc5 could not be found. Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c214c984-d0d9-4920-882c-6b481647edc5 could not be found. Jul 21 22:38:06.933915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:06.935460 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0996cbb6-e101-4e0a-9bc8-4046d477809b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Returning 404 to user: Instance c214c984-d0d9-4920-882c-6b481647edc5 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:38:06.935460 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0996cbb6-e101-4e0a-9bc8-4046d477809b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5" status: 404 len: 111 microversion: 2.1 time: 0.032470 Jul 21 22:38:06.935460 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 324/602] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:06 2022] GET /compute/v2.1/servers/c214c984-d0d9-4920-882c-6b481647edc5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:06.937369 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-81557132-040b-4de2-b063-47829ad09aa9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '.version_select at 0x7f47e66e2160>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:06.960926 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-81557132-040b-4de2-b063-47829ad09aa9 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-102915505" status: 202 len: 0 microversion: 2.1 time: 0.027517 Jul 21 22:38:06.962692 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 279/603] 10.222.0.58 () {58 vars in 1217 bytes} [Thu Jul 21 22:38:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-102915505 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:38:07.089601 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:38:07.089834 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Thu Jul 21 22:38:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:38:09.928324 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-527abd17-5c5c-432d-b13f-7ccd9278d796 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:09.929134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-527abd17-5c5c-432d-b13f-7ccd9278d796 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:09.936138 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-527abd17-5c5c-432d-b13f-7ccd9278d796 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:09.936590 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-527abd17-5c5c-432d-b13f-7ccd9278d796 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:09.937420 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-527abd17-5c5c-432d-b13f-7ccd9278d796 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:09.937893 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-527abd17-5c5c-432d-b13f-7ccd9278d796 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:09.965317 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-527abd17-5c5c-432d-b13f-7ccd9278d796 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Going to try to terminate instance {{(pid=124498) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:38:10.051999 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-527abd17-5c5c-432d-b13f-7ccd9278d796 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 204 len: 0 microversion: 2.1 time: 0.127354 Jul 21 22:38:10.053011 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 325/604] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:38:09 2022] DELETE /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:38:10.064870 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-56918d56-04e9-4d6b-b76e-d736e4a0c116 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:10.065524 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-56918d56-04e9-4d6b-b76e-d736e4a0c116 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:10.073518 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-56918d56-04e9-4d6b-b76e-d736e4a0c116 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:10.073994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-56918d56-04e9-4d6b-b76e-d736e4a0c116 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:10.074797 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-56918d56-04e9-4d6b-b76e-d736e4a0c116 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:10.075278 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-56918d56-04e9-4d6b-b76e-d736e4a0c116 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:10.223205 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-56918d56-04e9-4d6b-b76e-d736e4a0c116 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:10.231275 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-56918d56-04e9-4d6b-b76e-d736e4a0c116 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1508 microversion: 2.1 time: 0.171822 Jul 21 22:38:10.231911 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 280/605] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:10 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:11.253034 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6ae0b5e1-f401-4571-9ef3-a9cdbbc5fff1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:11.253745 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6ae0b5e1-f401-4571-9ef3-a9cdbbc5fff1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:11.260058 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ae0b5e1-f401-4571-9ef3-a9cdbbc5fff1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:11.260507 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ae0b5e1-f401-4571-9ef3-a9cdbbc5fff1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:11.261297 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ae0b5e1-f401-4571-9ef3-a9cdbbc5fff1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:11.261734 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ae0b5e1-f401-4571-9ef3-a9cdbbc5fff1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:11.416183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6ae0b5e1-f401-4571-9ef3-a9cdbbc5fff1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:11.424307 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6ae0b5e1-f401-4571-9ef3-a9cdbbc5fff1 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1508 microversion: 2.1 time: 0.177334 Jul 21 22:38:11.424894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 326/606] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:11 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:12.443229 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8c915d98-b7ae-446b-a41c-0e61dc12cf00 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:12.443897 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-8c915d98-b7ae-446b-a41c-0e61dc12cf00 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:12.451210 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8c915d98-b7ae-446b-a41c-0e61dc12cf00 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:12.451795 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8c915d98-b7ae-446b-a41c-0e61dc12cf00 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:12.452789 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8c915d98-b7ae-446b-a41c-0e61dc12cf00 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:12.453313 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8c915d98-b7ae-446b-a41c-0e61dc12cf00 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:12.600794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8c915d98-b7ae-446b-a41c-0e61dc12cf00 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:12.608960 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8c915d98-b7ae-446b-a41c-0e61dc12cf00 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1508 microversion: 2.1 time: 0.170985 Jul 21 22:38:12.609608 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 281/607] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:12 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:13.197579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-279ad221-15ba-4c2f-b63b-e272f11c2e54 req-d16a4e6f-a6ac-428c-9ea2-e5cd8f834076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2256ebb9-3077-4700-bdc1-bdfd57d082a5", "name": "network-vif-deleted", "tag": "9d9b621d-5324-47aa-be89-af4177fdd319"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:13.207511 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-279ad221-15ba-4c2f-b63b-e272f11c2e54 req-d16a4e6f-a6ac-428c-9ea2-e5cd8f834076 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:13.207877 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-279ad221-15ba-4c2f-b63b-e272f11c2e54 req-d16a4e6f-a6ac-428c-9ea2-e5cd8f834076 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:13.222383 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-279ad221-15ba-4c2f-b63b-e272f11c2e54 req-d16a4e6f-a6ac-428c-9ea2-e5cd8f834076 service nova] Creating event network-vif-deleted:9d9b621d-5324-47aa-be89-af4177fdd319 for instance 2256ebb9-3077-4700-bdc1-bdfd57d082a5 on hv-cinder-85069 Jul 21 22:38:13.228622 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-279ad221-15ba-4c2f-b63b-e272f11c2e54 req-d16a4e6f-a6ac-428c-9ea2-e5cd8f834076 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034548 Jul 21 22:38:13.229861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 327/608] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:38:13.627844 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-21418ef7-8d29-469f-aab6-78dcc0f16916 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:13.628462 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-21418ef7-8d29-469f-aab6-78dcc0f16916 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:13.636124 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-21418ef7-8d29-469f-aab6-78dcc0f16916 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:13.636350 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-21418ef7-8d29-469f-aab6-78dcc0f16916 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:13.637324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-21418ef7-8d29-469f-aab6-78dcc0f16916 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:13.637611 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-21418ef7-8d29-469f-aab6-78dcc0f16916 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:13.659977 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:13.679380 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-21418ef7-8d29-469f-aab6-78dcc0f16916 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:13.679830 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-21418ef7-8d29-469f-aab6-78dcc0f16916 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:13.680265 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-21418ef7-8d29-469f-aab6-78dcc0f16916 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lazy-loading 'fault' on Instance uuid 2256ebb9-3077-4700-bdc1-bdfd57d082a5 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:38:13.752248 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-21418ef7-8d29-469f-aab6-78dcc0f16916 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:13.761015 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-21418ef7-8d29-469f-aab6-78dcc0f16916 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 200 len: 1312 microversion: 2.1 time: 0.137300 Jul 21 22:38:13.761712 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 282/609] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:13 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 1312 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:14.779835 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a0e72afb-cd2b-402e-95db-46807e9bac57 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:14.780732 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a0e72afb-cd2b-402e-95db-46807e9bac57 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 2256ebb9-3077-4700-bdc1-bdfd57d082a5] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:14.788409 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a0e72afb-cd2b-402e-95db-46807e9bac57 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:14.788859 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a0e72afb-cd2b-402e-95db-46807e9bac57 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:14.789656 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a0e72afb-cd2b-402e-95db-46807e9bac57 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:14.790096 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a0e72afb-cd2b-402e-95db-46807e9bac57 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:14.806550 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-a0e72afb-cd2b-402e-95db-46807e9bac57 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] HTTP exception thrown: Instance 2256ebb9-3077-4700-bdc1-bdfd57d082a5 could not be found. Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a0e72afb-cd2b-402e-95db-46807e9bac57 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Request method failure captured: Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 HTTP/1.1 Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQcy_G8ocjTOCjKfuQiJgav55FcHkpRzXV2eQjXzWDayGJS8w3BYSyBfL-Cs1UDOIt1B3j3O6nqOG9p2BeXrgzNDFMGpTB6FKm7m_uSZW9Uo2VLu24MyVG3Pb1Z8P536qLitexREcsNaSkF2h16ltZ1uA89QIYJo0KijJzLAxeNAN0 Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 3138cf3bb8a24ba19295565fca0a471e Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:38:14.808277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3138cf3bb8a24ba19295565fca0a471e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 3138cf3bb8a24ba19295565fca0a471e Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-ServerRescueNegativeTestJSON-1702913491-project Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: cf3fd4428e3b46cd9e83e1d32571097b Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1702913491-project Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 2256ebb9-3077-4700-bdc1-bdfd57d082a5 could not be found. Jul 21 22:38:14.810891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '2256ebb9-3077-4700-bdc1-bdfd57d082a5'} Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2256ebb9-3077-4700-bdc1-bdfd57d082a5 could not be found. Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:38:14.812502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2256ebb9-3077-4700-bdc1-bdfd57d082a5 could not be found. Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2256ebb9-3077-4700-bdc1-bdfd57d082a5 could not be found. Jul 21 22:38:14.816357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:14.818408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a0e72afb-cd2b-402e-95db-46807e9bac57 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Returning 404 to user: Instance 2256ebb9-3077-4700-bdc1-bdfd57d082a5 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:38:14.818408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a0e72afb-cd2b-402e-95db-46807e9bac57 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5" status: 404 len: 111 microversion: 2.1 time: 0.034170 Jul 21 22:38:14.818408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 328/610] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:14 2022] GET /compute/v2.1/servers/2256ebb9-3077-4700-bdc1-bdfd57d082a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:14.820944 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-68e343db-7980-4135-95e6-05526f7b9d82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:14.821517 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-68e343db-7980-4135-95e6-05526f7b9d82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:14.828477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-68e343db-7980-4135-95e6-05526f7b9d82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:14.828927 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-68e343db-7980-4135-95e6-05526f7b9d82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:14.830494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-68e343db-7980-4135-95e6-05526f7b9d82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:14.830897 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-68e343db-7980-4135-95e6-05526f7b9d82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:14.859185 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-68e343db-7980-4135-95e6-05526f7b9d82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:38:14.956083 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-68e343db-7980-4135-95e6-05526f7b9d82 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 204 len: 0 microversion: 2.1 time: 0.137457 Jul 21 22:38:14.956985 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 283/611] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:38:14 2022] DELETE /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:38:14.965552 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e8e5707f-a922-40fd-9a36-bd338115c75f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:14.966193 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e8e5707f-a922-40fd-9a36-bd338115c75f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:14.973018 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8e5707f-a922-40fd-9a36-bd338115c75f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:14.973467 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8e5707f-a922-40fd-9a36-bd338115c75f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:14.974500 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8e5707f-a922-40fd-9a36-bd338115c75f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:14.975161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8e5707f-a922-40fd-9a36-bd338115c75f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:15.123136 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e8e5707f-a922-40fd-9a36-bd338115c75f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:15.132481 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e8e5707f-a922-40fd-9a36-bd338115c75f tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.171020 Jul 21 22:38:15.133156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 329/612] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:14 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:16.153975 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c34fbc44-f402-448d-9430-711134d7611c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:16.155247 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c34fbc44-f402-448d-9430-711134d7611c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:16.165860 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c34fbc44-f402-448d-9430-711134d7611c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:16.166631 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c34fbc44-f402-448d-9430-711134d7611c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:16.167512 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c34fbc44-f402-448d-9430-711134d7611c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:16.167948 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c34fbc44-f402-448d-9430-711134d7611c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:16.362968 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c34fbc44-f402-448d-9430-711134d7611c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:16.371191 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c34fbc44-f402-448d-9430-711134d7611c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.223588 Jul 21 22:38:16.371797 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 284/613] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:16 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:17.390101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-29464529-446e-481c-90e3-c83348e3ff5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:17.390749 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-29464529-446e-481c-90e3-c83348e3ff5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:17.398390 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29464529-446e-481c-90e3-c83348e3ff5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:17.399128 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29464529-446e-481c-90e3-c83348e3ff5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:17.400146 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29464529-446e-481c-90e3-c83348e3ff5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:17.400692 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29464529-446e-481c-90e3-c83348e3ff5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:17.545540 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-29464529-446e-481c-90e3-c83348e3ff5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:17.553613 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-29464529-446e-481c-90e3-c83348e3ff5b tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.167403 Jul 21 22:38:17.554204 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 330/614] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:17 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:18.570967 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d1f22e32-97fc-4312-a7fc-76e4526729e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:18.571634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d1f22e32-97fc-4312-a7fc-76e4526729e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:18.578924 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1f22e32-97fc-4312-a7fc-76e4526729e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:18.579453 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1f22e32-97fc-4312-a7fc-76e4526729e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:18.580281 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1f22e32-97fc-4312-a7fc-76e4526729e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:18.580724 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1f22e32-97fc-4312-a7fc-76e4526729e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:18.740424 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d1f22e32-97fc-4312-a7fc-76e4526729e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fd4428e3b46cd9e83e1d32571097b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3138cf3bb8a24ba19295565fca0a471e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:18.751689 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d1f22e32-97fc-4312-a7fc-76e4526729e8 tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 200 len: 1522 microversion: 2.1 time: 0.184125 Jul 21 22:38:18.752619 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 285/615] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:18 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:19.092735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-ccfc6e73-8600-415d-8bd1-95fbb62b4cdc req-8d7a1df3-d88d-48e9-9fa9-89a22717d5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967535ed-7748-4181-a946-d67bfbb813d0", "name": "network-vif-deleted", "tag": "a64b5308-fbc3-42f2-a21e-3de790b55a40"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:19.103472 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-ccfc6e73-8600-415d-8bd1-95fbb62b4cdc req-8d7a1df3-d88d-48e9-9fa9-89a22717d5a3 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:19.104060 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-ccfc6e73-8600-415d-8bd1-95fbb62b4cdc req-8d7a1df3-d88d-48e9-9fa9-89a22717d5a3 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:19.118686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-ccfc6e73-8600-415d-8bd1-95fbb62b4cdc req-8d7a1df3-d88d-48e9-9fa9-89a22717d5a3 service nova] Creating event network-vif-deleted:a64b5308-fbc3-42f2-a21e-3de790b55a40 for instance 967535ed-7748-4181-a946-d67bfbb813d0 on hv-cinder-85069 Jul 21 22:38:19.124534 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-ccfc6e73-8600-415d-8bd1-95fbb62b4cdc req-8d7a1df3-d88d-48e9-9fa9-89a22717d5a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035420 Jul 21 22:38:19.125928 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 331/616] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:19.778533 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e22e42fc-8b08-426c-a0d4-b8f7b71d2b4c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:19.779158 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e22e42fc-8b08-426c-a0d4-b8f7b71d2b4c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] [instance: 967535ed-7748-4181-a946-d67bfbb813d0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:19.785569 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e22e42fc-8b08-426c-a0d4-b8f7b71d2b4c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:19.786013 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e22e42fc-8b08-426c-a0d4-b8f7b71d2b4c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:19.786783 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e22e42fc-8b08-426c-a0d4-b8f7b71d2b4c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:19.787253 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e22e42fc-8b08-426c-a0d4-b8f7b71d2b4c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:19.802125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-e22e42fc-8b08-426c-a0d4-b8f7b71d2b4c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] HTTP exception thrown: Instance 967535ed-7748-4181-a946-d67bfbb813d0 could not be found. Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e22e42fc-8b08-426c-a0d4-b8f7b71d2b4c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Request method failure captured: Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 HTTP/1.1 Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQcy_G8ocjTOCjKfuQiJgav55FcHkpRzXV2eQjXzWDayGJS8w3BYSyBfL-Cs1UDOIt1B3j3O6nqOG9p2BeXrgzNDFMGpTB6FKm7m_uSZW9Uo2VLu24MyVG3Pb1Z8P536qLitexREcsNaSkF2h16ltZ1uA89QIYJo0KijJzLAxeNAN0 Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 3138cf3bb8a24ba19295565fca0a471e Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:38:19.804137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3138cf3bb8a24ba19295565fca0a471e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3138cf3bb8a24ba19295565fca0a471e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 3138cf3bb8a24ba19295565fca0a471e Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1702913491 Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-ServerRescueNegativeTestJSON-1702913491-project Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: cf3fd4428e3b46cd9e83e1d32571097b Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1702913491-project Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance 967535ed-7748-4181-a946-d67bfbb813d0 could not be found. Jul 21 22:38:19.805810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': '967535ed-7748-4181-a946-d67bfbb813d0'} Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967535ed-7748-4181-a946-d67bfbb813d0 could not be found. Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:38:19.807513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967535ed-7748-4181-a946-d67bfbb813d0 could not be found. Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967535ed-7748-4181-a946-d67bfbb813d0 could not be found. Jul 21 22:38:19.808848 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:38:19.810150 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e22e42fc-8b08-426c-a0d4-b8f7b71d2b4c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] Returning 404 to user: Instance 967535ed-7748-4181-a946-d67bfbb813d0 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:38:19.810150 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e22e42fc-8b08-426c-a0d4-b8f7b71d2b4c tempest-ServerRescueNegativeTestJSON-1702913491 tempest-ServerRescueNegativeTestJSON-1702913491-project] 10.222.0.58 "GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0" status: 404 len: 111 microversion: 2.1 time: 0.031095 Jul 21 22:38:19.810150 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 286/617] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:19 2022] GET /compute/v2.1/servers/967535ed-7748-4181-a946-d67bfbb813d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:25.755434 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c64db4b4-095b-4499-a7f0-4a0bc3a5d928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:25.756001 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c64db4b4-095b-4499-a7f0-4a0bc3a5d928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:25.763528 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c64db4b4-095b-4499-a7f0-4a0bc3a5d928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:25.763996 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c64db4b4-095b-4499-a7f0-4a0bc3a5d928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:25.764863 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c64db4b4-095b-4499-a7f0-4a0bc3a5d928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:25.765400 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c64db4b4-095b-4499-a7f0-4a0bc3a5d928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:25.792664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c64db4b4-095b-4499-a7f0-4a0bc3a5d928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/ips" status: 200 len: 150 microversion: 2.1 time: 0.042937 Jul 21 22:38:25.793258 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 332/618] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 22:38:25 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:27.200855 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e346ac1d-d449-4375-8f9c-9f45deb37c99 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b74881ec-0cd2-4823-8981-9eea5ce0e15e"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:27.202588 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e346ac1d-d449-4375-8f9c-9f45deb37c99 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:27.209623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e346ac1d-d449-4375-8f9c-9f45deb37c99 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:27.210073 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e346ac1d-d449-4375-8f9c-9f45deb37c99 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:27.210854 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e346ac1d-d449-4375-8f9c-9f45deb37c99 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:27.211325 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e346ac1d-d449-4375-8f9c-9f45deb37c99 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:27.484773 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e346ac1d-d449-4375-8f9c-9f45deb37c99 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287679 Jul 21 22:38:27.485865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 287/619] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:38:27 2022] POST /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:38:30.230481 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e0c3ab94-3d90-41b7-8357-fe0473402d1b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:30.230979 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e0c3ab94-3d90-41b7-8357-fe0473402d1b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:30.237942 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e0c3ab94-3d90-41b7-8357-fe0473402d1b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:30.238444 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e0c3ab94-3d90-41b7-8357-fe0473402d1b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:30.239245 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e0c3ab94-3d90-41b7-8357-fe0473402d1b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:30.239691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e0c3ab94-3d90-41b7-8357-fe0473402d1b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:30.263076 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e0c3ab94-3d90-41b7-8357-fe0473402d1b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/ips" status: 200 len: 152 microversion: 2.20 time: 0.214267 Jul 21 22:38:30.263648 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 333/620] 10.222.0.58 () {60 vars in 1288 bytes} [Thu Jul 21 22:38:30 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/ips => generated 152 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:32.115415 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-280df285-661c-460b-9904-f59b333aa026 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:32.116792 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-280df285-661c-460b-9904-f59b333aa026 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:32.118735 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:32.126104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-280df285-661c-460b-9904-f59b333aa026 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:32.126591 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-280df285-661c-460b-9904-f59b333aa026 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:32.127560 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-280df285-661c-460b-9904-f59b333aa026 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:32.128056 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-280df285-661c-460b-9904-f59b333aa026 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:32.151934 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-280df285-661c-460b-9904-f59b333aa026 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lazy-loading 'flavor' on Instance uuid fec3661d-93ec-46ac-9d30-188e8863b110 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:38:32.435542 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-280df285-661c-460b-9904-f59b333aa026 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "POST /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/action" status: 202 len: 0 microversion: 2.20 time: 0.326247 Jul 21 22:38:32.436411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 288/621] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jul 21 22:38:32 2022] POST /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:38:32.451179 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6293410d-e47f-4b39-acba-11fe1d2d82ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:32.452504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6293410d-e47f-4b39-acba-11fe1d2d82ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:32.460831 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6293410d-e47f-4b39-acba-11fe1d2d82ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:32.461276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6293410d-e47f-4b39-acba-11fe1d2d82ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:32.462075 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6293410d-e47f-4b39-acba-11fe1d2d82ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:32.462508 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6293410d-e47f-4b39-acba-11fe1d2d82ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:32.604278 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6293410d-e47f-4b39-acba-11fe1d2d82ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:32.612469 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6293410d-e47f-4b39-acba-11fe1d2d82ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:32.613890 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6293410d-e47f-4b39-acba-11fe1d2d82ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:32.615031 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6293410d-e47f-4b39-acba-11fe1d2d82ef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.168798 Jul 21 22:38:32.615603 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 334/622] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:32 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:33.635099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b9ddd651-2c0b-42b0-94c2-7213387c3086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:33.635794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b9ddd651-2c0b-42b0-94c2-7213387c3086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:33.642812 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9ddd651-2c0b-42b0-94c2-7213387c3086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:33.643291 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9ddd651-2c0b-42b0-94c2-7213387c3086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:33.644057 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9ddd651-2c0b-42b0-94c2-7213387c3086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:33.644494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b9ddd651-2c0b-42b0-94c2-7213387c3086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:33.782123 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b9ddd651-2c0b-42b0-94c2-7213387c3086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:33.789995 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b9ddd651-2c0b-42b0-94c2-7213387c3086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:33.791542 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b9ddd651-2c0b-42b0-94c2-7213387c3086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:33.792673 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b9ddd651-2c0b-42b0-94c2-7213387c3086 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.162417 Jul 21 22:38:33.793225 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 289/623] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:33 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:34.811495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ef33d6f5-ec5b-4dcd-a79a-b0dfbb6bf5c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:34.812110 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ef33d6f5-ec5b-4dcd-a79a-b0dfbb6bf5c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:34.818270 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ef33d6f5-ec5b-4dcd-a79a-b0dfbb6bf5c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:34.818647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ef33d6f5-ec5b-4dcd-a79a-b0dfbb6bf5c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:34.819437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ef33d6f5-ec5b-4dcd-a79a-b0dfbb6bf5c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:34.819878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ef33d6f5-ec5b-4dcd-a79a-b0dfbb6bf5c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:34.823924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:34.955169 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ef33d6f5-ec5b-4dcd-a79a-b0dfbb6bf5c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:34.964771 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ef33d6f5-ec5b-4dcd-a79a-b0dfbb6bf5c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:34.966321 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ef33d6f5-ec5b-4dcd-a79a-b0dfbb6bf5c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:34.967538 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ef33d6f5-ec5b-4dcd-a79a-b0dfbb6bf5c6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.159936 Jul 21 22:38:34.968122 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 335/624] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:34 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:35.989079 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-de7216a0-7d5a-4591-bd96-3072f5bc7c20 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:35.989799 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-de7216a0-7d5a-4591-bd96-3072f5bc7c20 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:35.996804 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-de7216a0-7d5a-4591-bd96-3072f5bc7c20 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:35.997451 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-de7216a0-7d5a-4591-bd96-3072f5bc7c20 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:35.998215 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-de7216a0-7d5a-4591-bd96-3072f5bc7c20 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:35.998658 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-de7216a0-7d5a-4591-bd96-3072f5bc7c20 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:36.145287 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-de7216a0-7d5a-4591-bd96-3072f5bc7c20 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:36.150100 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9b9843ef-119e-4734-ae04-19bf7b1a5928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b74881ec-0cd2-4823-8981-9eea5ce0e15e"}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:36.151247 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-9b9843ef-119e-4734-ae04-19bf7b1a5928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:36.154394 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-de7216a0-7d5a-4591-bd96-3072f5bc7c20 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:36.155955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-de7216a0-7d5a-4591-bd96-3072f5bc7c20 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:36.157504 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-de7216a0-7d5a-4591-bd96-3072f5bc7c20 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.174298 Jul 21 22:38:36.157706 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b9843ef-119e-4734-ae04-19bf7b1a5928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:36.157975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b9843ef-119e-4734-ae04-19bf7b1a5928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:36.158113 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 290/625] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:35 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:36.159177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b9843ef-119e-4734-ae04-19bf7b1a5928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:36.159615 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b9843ef-119e-4734-ae04-19bf7b1a5928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:36.242926 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-9b9843ef-119e-4734-ae04-19bf7b1a5928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Invalid volume: volume b74881ec-0cd2-4823-8981-9eea5ce0e15e is already attached to instances: 707386e1-842c-43e5-aee3-c9068abc8d02 Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9b9843ef-119e-4734-ae04-19bf7b1a5928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: POST /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-volume_attachments HTTP/1.1 Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 74 Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:38:36.244661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {"volumeAttachment": {"volumeId": "b74881ec-0cd2-4823-8981-9eea5ce0e15e"}} Jul 21 22:38:36.246151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Invalid volume: volume b74881ec-0cd2-4823-8981-9eea5ce0e15e is already attached to instances: 707386e1-842c-43e5-aee3-c9068abc8d02 Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'server_id': '707386e1-842c-43e5-aee3-c9068abc8d02', 'body': {'volumeAttachment': {'volumeId': 'b74881ec-0cd2-4823-8981-9eea5ce0e15e'}}} Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b74881ec-0cd2-4823-8981-9eea5ce0e15e is already attached to instances: 707386e1-842c-43e5-aee3-c9068abc8d02 Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:36.246975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b74881ec-0cd2-4823-8981-9eea5ce0e15e is already attached to instances: 707386e1-842c-43e5-aee3-c9068abc8d02 Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:36.248354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:36.249924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:36.249924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:38:36.249924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:38:36.249924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b74881ec-0cd2-4823-8981-9eea5ce0e15e is already attached to instances: 707386e1-842c-43e5-aee3-c9068abc8d02 Jul 21 22:38:36.249924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:36.249924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9b9843ef-119e-4734-ae04-19bf7b1a5928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 400 to user: Invalid volume: volume b74881ec-0cd2-4823-8981-9eea5ce0e15e is already attached to instances: 707386e1-842c-43e5-aee3-c9068abc8d02 {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:38:36.249924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-9b9843ef-119e-4734-ae04-19bf7b1a5928 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100396 Jul 21 22:38:36.249924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 336/626] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:38:36 2022] POST /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 22:38:36.310488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3d85d904-3e6e-467f-8b13-3a07f266137e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:36.310982 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3d85d904-3e6e-467f-8b13-3a07f266137e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:36.317249 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3d85d904-3e6e-467f-8b13-3a07f266137e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:36.317709 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3d85d904-3e6e-467f-8b13-3a07f266137e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:36.318479 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3d85d904-3e6e-467f-8b13-3a07f266137e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:36.318919 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3d85d904-3e6e-467f-8b13-3a07f266137e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:36.400790 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-3d85d904-3e6e-467f-8b13-3a07f266137e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lazy-loading 'services' on Instance uuid 707386e1-842c-43e5-aee3-c9068abc8d02 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:38:36.524220 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3d85d904-3e6e-467f-8b13-3a07f266137e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-volume_attachments/b74881ec-0cd2-4823-8981-9eea5ce0e15e" status: 202 len: 0 microversion: 2.1 time: 0.217558 Jul 21 22:38:36.524839 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 291/627] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:38:36 2022] DELETE /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-volume_attachments/b74881ec-0cd2-4823-8981-9eea5ce0e15e => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:38:36.534046 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-86109c90-6296-413b-9dd2-b28c1d2c6cc2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:36.534984 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-86109c90-6296-413b-9dd2-b28c1d2c6cc2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:36.542374 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-86109c90-6296-413b-9dd2-b28c1d2c6cc2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:36.543263 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-86109c90-6296-413b-9dd2-b28c1d2c6cc2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:36.544048 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-86109c90-6296-413b-9dd2-b28c1d2c6cc2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:36.544549 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-86109c90-6296-413b-9dd2-b28c1d2c6cc2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:36.576616 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-86109c90-6296-413b-9dd2-b28c1d2c6cc2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047100 Jul 21 22:38:36.577179 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 337/628] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:38:36 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:37.178558 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-cd2489ef-603f-4fc5-bfef-29d929f29828 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:37.179398 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-cd2489ef-603f-4fc5-bfef-29d929f29828 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:37.189303 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cd2489ef-603f-4fc5-bfef-29d929f29828 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.189947 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cd2489ef-603f-4fc5-bfef-29d929f29828 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.190889 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cd2489ef-603f-4fc5-bfef-29d929f29828 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.191514 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-cd2489ef-603f-4fc5-bfef-29d929f29828 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.348373 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-cd2489ef-603f-4fc5-bfef-29d929f29828 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:37.357008 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-cd2489ef-603f-4fc5-bfef-29d929f29828 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:37.358667 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-cd2489ef-603f-4fc5-bfef-29d929f29828 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:37.360589 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-cd2489ef-603f-4fc5-bfef-29d929f29828 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.187668 Jul 21 22:38:37.361260 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 292/629] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:37 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:37.589386 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ec0407a7-65e2-47e8-a195-481e6a1baa65 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:37.590298 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ec0407a7-65e2-47e8-a195-481e6a1baa65 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:37.592186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:37.598677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ec0407a7-65e2-47e8-a195-481e6a1baa65 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.599248 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ec0407a7-65e2-47e8-a195-481e6a1baa65 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.600154 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ec0407a7-65e2-47e8-a195-481e6a1baa65 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.600654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ec0407a7-65e2-47e8-a195-481e6a1baa65 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.632196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ec0407a7-65e2-47e8-a195-481e6a1baa65 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046764 Jul 21 22:38:37.632757 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 338/630] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:38:37 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:38:37.694720 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a9c2851b-d322-42d2-82a5-a6f3166c2a5e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:37.695276 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a9c2851b-d322-42d2-82a5-a6f3166c2a5e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:37.702270 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a9c2851b-d322-42d2-82a5-a6f3166c2a5e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.702729 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a9c2851b-d322-42d2-82a5-a6f3166c2a5e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.704360 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a9c2851b-d322-42d2-82a5-a6f3166c2a5e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.704987 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a9c2851b-d322-42d2-82a5-a6f3166c2a5e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.730889 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a9c2851b-d322-42d2-82a5-a6f3166c2a5e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:38:37.733979 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:37.809746 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a9c2851b-d322-42d2-82a5-a6f3166c2a5e tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 204 len: 0 microversion: 2.1 time: 0.118832 Jul 21 22:38:37.810355 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 293/631] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:38:37 2022] DELETE /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:38:37.819384 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3655aced-946a-48c5-8ba9-1d18c5876308 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:37.820021 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3655aced-946a-48c5-8ba9-1d18c5876308 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:37.826117 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3655aced-946a-48c5-8ba9-1d18c5876308 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.826568 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3655aced-946a-48c5-8ba9-1d18c5876308 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.827367 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3655aced-946a-48c5-8ba9-1d18c5876308 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.827804 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3655aced-946a-48c5-8ba9-1d18c5876308 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.959219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3655aced-946a-48c5-8ba9-1d18c5876308 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:37.966628 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3655aced-946a-48c5-8ba9-1d18c5876308 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1682 microversion: 2.1 time: 0.151369 Jul 21 22:38:37.967220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 339/632] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:37 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:38.379259 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1c32841c-2d75-42e0-9920-2183ff99bb51 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:38.379958 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1c32841c-2d75-42e0-9920-2183ff99bb51 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:38.388063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1c32841c-2d75-42e0-9920-2183ff99bb51 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:38.388063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1c32841c-2d75-42e0-9920-2183ff99bb51 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:38.388063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1c32841c-2d75-42e0-9920-2183ff99bb51 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:38.388651 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1c32841c-2d75-42e0-9920-2183ff99bb51 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:38.529167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1c32841c-2d75-42e0-9920-2183ff99bb51 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:38.538091 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1c32841c-2d75-42e0-9920-2183ff99bb51 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:38.539742 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1c32841c-2d75-42e0-9920-2183ff99bb51 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:38.540998 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1c32841c-2d75-42e0-9920-2183ff99bb51 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.166122 Jul 21 22:38:38.541624 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 294/633] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:38 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:38.983739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a717500a-aac6-4d46-9ade-31c094a4c900 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:38.984464 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a717500a-aac6-4d46-9ade-31c094a4c900 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:38.991104 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a717500a-aac6-4d46-9ade-31c094a4c900 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:38.991551 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a717500a-aac6-4d46-9ade-31c094a4c900 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:38.992316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a717500a-aac6-4d46-9ade-31c094a4c900 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:38.992750 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a717500a-aac6-4d46-9ade-31c094a4c900 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:39.192126 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a717500a-aac6-4d46-9ade-31c094a4c900 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:39.200282 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a717500a-aac6-4d46-9ade-31c094a4c900 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1682 microversion: 2.1 time: 0.220279 Jul 21 22:38:39.200866 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 340/634] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:38 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:39.559467 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-31839cf5-ce82-4f3a-b201-236b49c617e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:39.560162 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-31839cf5-ce82-4f3a-b201-236b49c617e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:39.567516 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-31839cf5-ce82-4f3a-b201-236b49c617e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:39.567966 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-31839cf5-ce82-4f3a-b201-236b49c617e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:39.568742 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-31839cf5-ce82-4f3a-b201-236b49c617e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:39.569177 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-31839cf5-ce82-4f3a-b201-236b49c617e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:39.712268 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-31839cf5-ce82-4f3a-b201-236b49c617e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:39.723094 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-31839cf5-ce82-4f3a-b201-236b49c617e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:39.724552 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-31839cf5-ce82-4f3a-b201-236b49c617e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:39.725743 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-31839cf5-ce82-4f3a-b201-236b49c617e1 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.170387 Jul 21 22:38:39.726313 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 295/635] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:39 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:40.220479 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-705d7544-39e3-47cf-a69f-d5841ad8545a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:40.221195 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-705d7544-39e3-47cf-a69f-d5841ad8545a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:40.227730 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-705d7544-39e3-47cf-a69f-d5841ad8545a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:40.228347 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-705d7544-39e3-47cf-a69f-d5841ad8545a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:40.229341 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-705d7544-39e3-47cf-a69f-d5841ad8545a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:40.229848 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-705d7544-39e3-47cf-a69f-d5841ad8545a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:40.298926 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-705d7544-39e3-47cf-a69f-d5841ad8545a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:40.314747 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-705d7544-39e3-47cf-a69f-d5841ad8545a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 200 len: 1614 microversion: 2.1 time: 0.099381 Jul 21 22:38:40.315843 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 341/636] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:40 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 1614 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:40.654764 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-af11d530-9798-428d-9f35-d3bd39f5f1f2 req-2f9ac30f-3734-47a8-bb42-2e7eb61a8a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707386e1-842c-43e5-aee3-c9068abc8d02", "name": "network-vif-deleted", "tag": "3b89f5f0-5c0a-4913-9efe-245565036ad6"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:40.671912 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-af11d530-9798-428d-9f35-d3bd39f5f1f2 req-2f9ac30f-3734-47a8-bb42-2e7eb61a8a69 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:40.673081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-af11d530-9798-428d-9f35-d3bd39f5f1f2 req-2f9ac30f-3734-47a8-bb42-2e7eb61a8a69 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:40.689747 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-af11d530-9798-428d-9f35-d3bd39f5f1f2 req-2f9ac30f-3734-47a8-bb42-2e7eb61a8a69 service nova] Creating event network-vif-deleted:3b89f5f0-5c0a-4913-9efe-245565036ad6 for instance 707386e1-842c-43e5-aee3-c9068abc8d02 on hv-cinder-85069 Jul 21 22:38:40.696856 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-af11d530-9798-428d-9f35-d3bd39f5f1f2 req-2f9ac30f-3734-47a8-bb42-2e7eb61a8a69 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250136 Jul 21 22:38:40.697885 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 296/637] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:40.746609 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c3779345-9dd9-48ea-8c0b-ee0bd94ac6f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:40.747349 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c3779345-9dd9-48ea-8c0b-ee0bd94ac6f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:40.755564 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c3779345-9dd9-48ea-8c0b-ee0bd94ac6f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:40.756565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c3779345-9dd9-48ea-8c0b-ee0bd94ac6f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:40.757542 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c3779345-9dd9-48ea-8c0b-ee0bd94ac6f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:40.758145 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c3779345-9dd9-48ea-8c0b-ee0bd94ac6f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:40.802479 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-43663925-a51b-4d6c-b570-b1b6d0d59e72 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:40.803027 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-43663925-a51b-4d6c-b570-b1b6d0d59e72 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:40.810069 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43663925-a51b-4d6c-b570-b1b6d0d59e72 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:40.810533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43663925-a51b-4d6c-b570-b1b6d0d59e72 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:40.811340 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43663925-a51b-4d6c-b570-b1b6d0d59e72 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:40.811948 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43663925-a51b-4d6c-b570-b1b6d0d59e72 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:40.839954 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-43663925-a51b-4d6c-b570-b1b6d0d59e72 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/ips" status: 200 len: 146 microversion: 2.1 time: 0.243431 Jul 21 22:38:40.846616 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 342/638] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 22:38:40 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/ips => generated 146 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:38:40.980778 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c3779345-9dd9-48ea-8c0b-ee0bd94ac6f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:40.994221 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c3779345-9dd9-48ea-8c0b-ee0bd94ac6f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:40.996008 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c3779345-9dd9-48ea-8c0b-ee0bd94ac6f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:40.997192 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c3779345-9dd9-48ea-8c0b-ee0bd94ac6f2 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.256587 Jul 21 22:38:40.997749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 297/639] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:40 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:38:41.334455 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2db3dea7-20aa-4473-98b5-e77cd42c4fc1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:41.335264 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2db3dea7-20aa-4473-98b5-e77cd42c4fc1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:41.347716 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2db3dea7-20aa-4473-98b5-e77cd42c4fc1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:41.347716 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2db3dea7-20aa-4473-98b5-e77cd42c4fc1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:41.349170 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2db3dea7-20aa-4473-98b5-e77cd42c4fc1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:41.351524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2db3dea7-20aa-4473-98b5-e77cd42c4fc1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:41.367413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-2db3dea7-20aa-4473-98b5-e77cd42c4fc1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2db3dea7-20aa-4473-98b5-e77cd42c4fc1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 HTTP/1.1 Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:38:41.369579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:38:41.371433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '707386e1-842c-43e5-aee3-c9068abc8d02'} Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:38:41.372339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:38:41.373826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:38:41.375831 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2db3dea7-20aa-4473-98b5-e77cd42c4fc1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:38:41.375831 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2db3dea7-20aa-4473-98b5-e77cd42c4fc1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 404 len: 111 microversion: 2.1 time: 0.041863 Jul 21 22:38:41.375831 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 343/640] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:41 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:41.380885 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-bc4cb407-d4c2-4675-a90a-99aa67561322 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '.version_select at 0x7f47e6641310>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:41.406644 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-bc4cb407-d4c2-4675-a90a-99aa67561322 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133580581" status: 202 len: 0 microversion: 2.1 time: 0.029614 Jul 21 22:38:41.407412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 298/641] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jul 21 22:38:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133580581 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:38:42.018699 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-49dde154-3f1c-40d2-b5d2-a9c42ed8ceef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:42.019617 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-49dde154-3f1c-40d2-b5d2-a9c42ed8ceef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:42.026404 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-49dde154-3f1c-40d2-b5d2-a9c42ed8ceef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:42.026943 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-49dde154-3f1c-40d2-b5d2-a9c42ed8ceef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:42.027881 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-49dde154-3f1c-40d2-b5d2-a9c42ed8ceef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:42.028401 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-49dde154-3f1c-40d2-b5d2-a9c42ed8ceef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:42.109925 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4e5bea35-60b9-4355-b60d-10e6a559ce9f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: .version_select at 0x7f47e6797040>, body: {"keypair": {"name": "tempest-keypair-220082898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA61FolcfuZDHFc9EWALIEPd3S5cgYMG89sMOaaMQQLz0kmFC+gDgBNz8hoyOwPUyqaIbGxiXCOiSK4MAr4PpiJGQcuZ3oRKIdNTAepD/pnVgTolme1XxxMB192qlrM44A=="}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:42.128286 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-4e5bea35-60b9-4355-b60d-10e6a559ce9f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:38:42.132553 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-4e5bea35-60b9-4355-b60d-10e6a559ce9f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for user c4284eb173fc49d1b059fdd2f3de2b4d and project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:38:42.160471 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4e5bea35-60b9-4355-b60d-10e6a559ce9f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055241 Jul 21 22:38:42.161390 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 299/642] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 22:38:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:42.176586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-49dde154-3f1c-40d2-b5d2-a9c42ed8ceef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:42.188729 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-49dde154-3f1c-40d2-b5d2-a9c42ed8ceef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:42.190569 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-49dde154-3f1c-40d2-b5d2-a9c42ed8ceef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:42.191825 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-49dde154-3f1c-40d2-b5d2-a9c42ed8ceef tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.178001 Jul 21 22:38:42.202321 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 344/643] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:42 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:38:42.295140 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a836d925-66da-4abd-a813-99e1179a3d9b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e50adeb7-d78d-4a57-8bcd-eecd0947a723"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:42.296265 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a836d925-66da-4abd-a813-99e1179a3d9b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:42.303418 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a836d925-66da-4abd-a813-99e1179a3d9b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:42.303906 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a836d925-66da-4abd-a813-99e1179a3d9b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:42.304919 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a836d925-66da-4abd-a813-99e1179a3d9b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:42.305537 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a836d925-66da-4abd-a813-99e1179a3d9b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:42.618624 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a836d925-66da-4abd-a813-99e1179a3d9b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "POST /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328031 Jul 21 22:38:42.620027 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 300/644] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:38:42 2022] POST /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:43.214130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d8ce3660-842e-4bc4-a3ae-f41c0ee0e6a0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:43.214944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d8ce3660-842e-4bc4-a3ae-f41c0ee0e6a0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:43.222458 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d8ce3660-842e-4bc4-a3ae-f41c0ee0e6a0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:43.222908 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d8ce3660-842e-4bc4-a3ae-f41c0ee0e6a0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:43.223739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d8ce3660-842e-4bc4-a3ae-f41c0ee0e6a0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:43.224170 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d8ce3660-842e-4bc4-a3ae-f41c0ee0e6a0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:43.464704 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d8ce3660-842e-4bc4-a3ae-f41c0ee0e6a0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:43.478078 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d8ce3660-842e-4bc4-a3ae-f41c0ee0e6a0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:43.479929 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d8ce3660-842e-4bc4-a3ae-f41c0ee0e6a0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:43.481070 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d8ce3660-842e-4bc4-a3ae-f41c0ee0e6a0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.274052 Jul 21 22:38:43.481997 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 345/645] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:43 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:43.805374 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-8469904", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f846e054-e088-4d42-aada-300493577c1f"}], "security_groups": [{"name": "tempest-securitygroup--378624811"}], "key_name": "tempest-keypair-220082898", "user_data": "}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:43.913542 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] validate_networks() for [('f846e054-e088-4d42-aada-300493577c1f', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:38:44.387918 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:38:44.388349 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:38:44.388824 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:38:44.389233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:38:44.389641 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:38:44.398852 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:44.399693 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:44.400211 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:44.400652 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:44.417216 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:38:44.421038 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Getting quotas for user c4284eb173fc49d1b059fdd2f3de2b4d and project d5c8c5bf1b1c4caeab8b5daf28ada57d. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:38:44.432659 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:38:44.435034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:38:44.480712 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2d5f597e-8d6e-48fe-bc76-6cd134144dbd tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.680488 Jul 21 22:38:44.481372 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 301/646] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:38:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:38:44.492689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2e452798-fe5f-4f42-be07-4293c55c36cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:44.493294 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2e452798-fe5f-4f42-be07-4293c55c36cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:44.500698 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7f38abea-7aeb-4420-9f6f-5ea1db1f92f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:44.501310 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7f38abea-7aeb-4420-9f6f-5ea1db1f92f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:44.507764 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7f38abea-7aeb-4420-9f6f-5ea1db1f92f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:44.508221 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7f38abea-7aeb-4420-9f6f-5ea1db1f92f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:44.508993 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7f38abea-7aeb-4420-9f6f-5ea1db1f92f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:44.509431 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7f38abea-7aeb-4420-9f6f-5ea1db1f92f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:44.614788 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2e452798-fe5f-4f42-be07-4293c55c36cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:44.622692 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2e452798-fe5f-4f42-be07-4293c55c36cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1238 microversion: 2.1 time: 0.133483 Jul 21 22:38:44.623510 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 346/647] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:44 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1238 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:44.674950 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7f38abea-7aeb-4420-9f6f-5ea1db1f92f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:44.684475 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7f38abea-7aeb-4420-9f6f-5ea1db1f92f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:44.686067 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7f38abea-7aeb-4420-9f6f-5ea1db1f92f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:44.687454 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7f38abea-7aeb-4420-9f6f-5ea1db1f92f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.190818 Jul 21 22:38:44.691123 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 302/648] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:44 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:45.640060 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-de15cc94-489d-4e59-b7e6-8affe5d3ad24 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:45.640734 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-de15cc94-489d-4e59-b7e6-8affe5d3ad24 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:45.647068 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-de15cc94-489d-4e59-b7e6-8affe5d3ad24 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:45.647533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-de15cc94-489d-4e59-b7e6-8affe5d3ad24 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:45.648307 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-de15cc94-489d-4e59-b7e6-8affe5d3ad24 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:45.648748 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-de15cc94-489d-4e59-b7e6-8affe5d3ad24 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:45.709826 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-87660dc2-64eb-4136-8ad4-b60de5663092 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:45.710438 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-87660dc2-64eb-4136-8ad4-b60de5663092 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:45.718167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-87660dc2-64eb-4136-8ad4-b60de5663092 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:45.718864 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-87660dc2-64eb-4136-8ad4-b60de5663092 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:45.719681 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-87660dc2-64eb-4136-8ad4-b60de5663092 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:45.720122 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-87660dc2-64eb-4136-8ad4-b60de5663092 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:45.740874 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-de15cc94-489d-4e59-b7e6-8affe5d3ad24 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:45.748926 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-de15cc94-489d-4e59-b7e6-8affe5d3ad24 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1298 microversion: 2.1 time: 0.112616 Jul 21 22:38:45.749770 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 347/649] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:45 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:46.161986 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-87660dc2-64eb-4136-8ad4-b60de5663092 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:46.171113 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-87660dc2-64eb-4136-8ad4-b60de5663092 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:46.173744 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-87660dc2-64eb-4136-8ad4-b60de5663092 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:46.174926 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-87660dc2-64eb-4136-8ad4-b60de5663092 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.469080 Jul 21 22:38:46.175787 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 303/650] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:45 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:46.768727 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-72186fad-c650-4911-868d-ff394c3c4939 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:46.769294 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-72186fad-c650-4911-868d-ff394c3c4939 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:46.775547 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-72186fad-c650-4911-868d-ff394c3c4939 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:46.775995 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-72186fad-c650-4911-868d-ff394c3c4939 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:46.776762 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-72186fad-c650-4911-868d-ff394c3c4939 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:46.777200 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-72186fad-c650-4911-868d-ff394c3c4939 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:46.911606 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-72186fad-c650-4911-868d-ff394c3c4939 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:46.924186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-72186fad-c650-4911-868d-ff394c3c4939 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1363 microversion: 2.1 time: 0.160937 Jul 21 22:38:46.925215 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 348/651] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:46 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:47.193687 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6ea82644-a8eb-44cd-b4e6-bc4a09d06e14 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:47.195452 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-6ea82644-a8eb-44cd-b4e6-bc4a09d06e14 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:47.202658 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6ea82644-a8eb-44cd-b4e6-bc4a09d06e14 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:47.204390 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6ea82644-a8eb-44cd-b4e6-bc4a09d06e14 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:47.204592 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6ea82644-a8eb-44cd-b4e6-bc4a09d06e14 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:47.205029 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6ea82644-a8eb-44cd-b4e6-bc4a09d06e14 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:47.276873 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-b3278fe8-81d6-4389-a93c-8ae6098cfe44 req-4b305ece-c4b8-4f99-a45e-dee375a4c5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17eec69-e042-4b07-92e3-81b8c2710904", "tag": "3fd9e5c7-12f2-4318-9993-a73043acaac8"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:47.309113 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-b3278fe8-81d6-4389-a93c-8ae6098cfe44 req-4b305ece-c4b8-4f99-a45e-dee375a4c5d5 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:47.312549 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-b3278fe8-81d6-4389-a93c-8ae6098cfe44 req-4b305ece-c4b8-4f99-a45e-dee375a4c5d5 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:47.331763 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-b3278fe8-81d6-4389-a93c-8ae6098cfe44 req-4b305ece-c4b8-4f99-a45e-dee375a4c5d5 service nova] Creating event network-changed:3fd9e5c7-12f2-4318-9993-a73043acaac8 for instance e17eec69-e042-4b07-92e3-81b8c2710904 on hv-cinder-85069 Jul 21 22:38:47.347394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-b3278fe8-81d6-4389-a93c-8ae6098cfe44 req-4b305ece-c4b8-4f99-a45e-dee375a4c5d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073971 Jul 21 22:38:47.349339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 349/652] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:47.427643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6ea82644-a8eb-44cd-b4e6-bc4a09d06e14 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:47.437205 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6ea82644-a8eb-44cd-b4e6-bc4a09d06e14 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:47.445726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6ea82644-a8eb-44cd-b4e6-bc4a09d06e14 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:47.445726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6ea82644-a8eb-44cd-b4e6-bc4a09d06e14 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.250574 Jul 21 22:38:47.445726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 304/653] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:47 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:38:47.944276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e112a306-edbd-477f-817f-4b6f873f73f5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:47.944974 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e112a306-edbd-477f-817f-4b6f873f73f5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:47.958958 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e112a306-edbd-477f-817f-4b6f873f73f5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:47.959327 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e112a306-edbd-477f-817f-4b6f873f73f5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:47.960140 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e112a306-edbd-477f-817f-4b6f873f73f5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:47.960579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e112a306-edbd-477f-817f-4b6f873f73f5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:48.098541 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e112a306-edbd-477f-817f-4b6f873f73f5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:48.106065 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e112a306-edbd-477f-817f-4b6f873f73f5 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1363 microversion: 2.1 time: 0.166015 Jul 21 22:38:48.106636 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 350/654] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:47 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:48.473393 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a7a37af9-91de-4e56-a147-61f642ab450e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:48.473932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a7a37af9-91de-4e56-a147-61f642ab450e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:48.480571 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7a37af9-91de-4e56-a147-61f642ab450e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:48.481081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7a37af9-91de-4e56-a147-61f642ab450e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:48.481800 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7a37af9-91de-4e56-a147-61f642ab450e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:48.482272 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7a37af9-91de-4e56-a147-61f642ab450e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:48.616324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a7a37af9-91de-4e56-a147-61f642ab450e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:48.624384 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a7a37af9-91de-4e56-a147-61f642ab450e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:48.626183 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a7a37af9-91de-4e56-a147-61f642ab450e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:48.627375 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a7a37af9-91de-4e56-a147-61f642ab450e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1745 microversion: 2.20 time: 0.158823 Jul 21 22:38:48.627937 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 305/655] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:48 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:49.123511 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-960c138a-0c7b-48b9-9b17-2765c3fc8c4b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:49.124098 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-960c138a-0c7b-48b9-9b17-2765c3fc8c4b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:49.130423 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-960c138a-0c7b-48b9-9b17-2765c3fc8c4b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:49.130926 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-960c138a-0c7b-48b9-9b17-2765c3fc8c4b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:49.131741 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-960c138a-0c7b-48b9-9b17-2765c3fc8c4b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:49.132216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-960c138a-0c7b-48b9-9b17-2765c3fc8c4b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:49.260095 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-960c138a-0c7b-48b9-9b17-2765c3fc8c4b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:49.268164 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-960c138a-0c7b-48b9-9b17-2765c3fc8c4b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1363 microversion: 2.1 time: 0.148504 Jul 21 22:38:49.268740 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 351/656] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:49 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:49.646293 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7fe13661-9aed-45bf-b723-cd8364451126 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:49.647269 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7fe13661-9aed-45bf-b723-cd8364451126 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:49.654772 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7fe13661-9aed-45bf-b723-cd8364451126 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:49.655675 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7fe13661-9aed-45bf-b723-cd8364451126 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:49.657727 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7fe13661-9aed-45bf-b723-cd8364451126 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:49.658398 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7fe13661-9aed-45bf-b723-cd8364451126 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:49.808412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7fe13661-9aed-45bf-b723-cd8364451126 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:49.817677 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7fe13661-9aed-45bf-b723-cd8364451126 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:49.819235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7fe13661-9aed-45bf-b723-cd8364451126 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:49.820416 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7fe13661-9aed-45bf-b723-cd8364451126 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1745 microversion: 2.20 time: 0.178464 Jul 21 22:38:49.820977 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 306/657] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:49 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:50.216482 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e3ceb7cf-7930-4cd3-9d43-aa521f9ccf3e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:50.217410 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e3ceb7cf-7930-4cd3-9d43-aa521f9ccf3e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:50.224823 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e3ceb7cf-7930-4cd3-9d43-aa521f9ccf3e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.225292 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e3ceb7cf-7930-4cd3-9d43-aa521f9ccf3e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:50.226038 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e3ceb7cf-7930-4cd3-9d43-aa521f9ccf3e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.226474 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e3ceb7cf-7930-4cd3-9d43-aa521f9ccf3e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:50.270120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e3ceb7cf-7930-4cd3-9d43-aa521f9ccf3e tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057523 Jul 21 22:38:50.270701 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 352/658] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:38:50 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:50.283180 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-ce6299d0-69e8-42a3-83de-3bdf69220fca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:50.283967 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-ce6299d0-69e8-42a3-83de-3bdf69220fca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:50.290091 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f5e58308-7247-4007-9845-fe3d8761769a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:50.291713 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f5e58308-7247-4007-9845-fe3d8761769a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:50.291972 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ce6299d0-69e8-42a3-83de-3bdf69220fca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.292610 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ce6299d0-69e8-42a3-83de-3bdf69220fca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:50.293555 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ce6299d0-69e8-42a3-83de-3bdf69220fca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.294154 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ce6299d0-69e8-42a3-83de-3bdf69220fca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:50.302365 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f5e58308-7247-4007-9845-fe3d8761769a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.303090 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f5e58308-7247-4007-9845-fe3d8761769a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:50.303872 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f5e58308-7247-4007-9845-fe3d8761769a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.305121 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f5e58308-7247-4007-9845-fe3d8761769a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:50.331559 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-ce6299d0-69e8-42a3-83de-3bdf69220fca tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments/e50adeb7-d78d-4a57-8bcd-eecd0947a723" status: 200 len: 194 microversion: 2.1 time: 0.054151 Jul 21 22:38:50.332444 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 307/659] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Jul 21 22:38:50 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments/e50adeb7-d78d-4a57-8bcd-eecd0947a723 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:38:50.482601 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f5e58308-7247-4007-9845-fe3d8761769a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:50.493212 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f5e58308-7247-4007-9845-fe3d8761769a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1363 microversion: 2.1 time: 0.207060 Jul 21 22:38:50.520368 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 353/660] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:50 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:50.850494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-91660fec-f3df-4dea-8b5b-1ab41198263f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:50.853617 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-91660fec-f3df-4dea-8b5b-1ab41198263f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:50.860721 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-91660fec-f3df-4dea-8b5b-1ab41198263f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.861315 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-91660fec-f3df-4dea-8b5b-1ab41198263f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:50.862193 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-91660fec-f3df-4dea-8b5b-1ab41198263f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.863244 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-91660fec-f3df-4dea-8b5b-1ab41198263f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:51.060514 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-91660fec-f3df-4dea-8b5b-1ab41198263f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:51.089226 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-91660fec-f3df-4dea-8b5b-1ab41198263f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:51.092405 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-91660fec-f3df-4dea-8b5b-1ab41198263f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:51.094701 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-91660fec-f3df-4dea-8b5b-1ab41198263f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.248693 Jul 21 22:38:51.098453 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 308/661] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:50 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:51.513460 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-fe8a6f1c-674b-40fc-8a16-e09703c80b43 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:51.517755 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-fe8a6f1c-674b-40fc-8a16-e09703c80b43 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:51.535343 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fe8a6f1c-674b-40fc-8a16-e09703c80b43 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:51.541455 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fe8a6f1c-674b-40fc-8a16-e09703c80b43 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:51.542968 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fe8a6f1c-674b-40fc-8a16-e09703c80b43 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:51.547903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fe8a6f1c-674b-40fc-8a16-e09703c80b43 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:51.596850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=100 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:51.814932 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-fe8a6f1c-674b-40fc-8a16-e09703c80b43 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:51.840634 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-fe8a6f1c-674b-40fc-8a16-e09703c80b43 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1363 microversion: 2.1 time: 0.332262 Jul 21 22:38:51.850322 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 354/662] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:51 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:51.858279 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3058eda8-fcaf-4906-80bc-96a19cd4d100 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e61e56fc-d931-47a8-af0c-1314ed219461"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:51.867823 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3058eda8-fcaf-4906-80bc-96a19cd4d100 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:51.875862 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3058eda8-fcaf-4906-80bc-96a19cd4d100 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:51.876359 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3058eda8-fcaf-4906-80bc-96a19cd4d100 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:51.877206 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3058eda8-fcaf-4906-80bc-96a19cd4d100 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:51.877706 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3058eda8-fcaf-4906-80bc-96a19cd4d100 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.114846 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1bda120c-ad00-49e2-bd03-ef993096f060 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:52.115511 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1bda120c-ad00-49e2-bd03-ef993096f060 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:52.122029 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1bda120c-ad00-49e2-bd03-ef993096f060 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.129879 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1bda120c-ad00-49e2-bd03-ef993096f060 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.131335 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1bda120c-ad00-49e2-bd03-ef993096f060 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.132009 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1bda120c-ad00-49e2-bd03-ef993096f060 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.298550 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:52.368043 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3058eda8-fcaf-4906-80bc-96a19cd4d100 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "POST /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533737 Jul 21 22:38:52.371016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 309/663] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:38:51 2022] POST /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments => generated 194 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:52.471410 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1bda120c-ad00-49e2-bd03-ef993096f060 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:52.483798 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1bda120c-ad00-49e2-bd03-ef993096f060 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:52.485881 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1bda120c-ad00-49e2-bd03-ef993096f060 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:52.487242 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1bda120c-ad00-49e2-bd03-ef993096f060 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.376781 Jul 21 22:38:52.492501 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 355/664] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:52 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:52.794327 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-d57f889a-7659-4b43-a5cb-3703a79b918e req-4812718a-1997-4e23-b900-691e0b80914c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec3661d-93ec-46ac-9d30-188e8863b110", "name": "network-vif-plugged", "status": "completed", "tag": "a6bccf3e-2937-4ac6-854c-3de5f045836d"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:52.809007 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-d57f889a-7659-4b43-a5cb-3703a79b918e req-4812718a-1997-4e23-b900-691e0b80914c service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.810515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-d57f889a-7659-4b43-a5cb-3703a79b918e req-4812718a-1997-4e23-b900-691e0b80914c service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.824086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-d57f889a-7659-4b43-a5cb-3703a79b918e req-4812718a-1997-4e23-b900-691e0b80914c service nova] Creating event network-vif-plugged:a6bccf3e-2937-4ac6-854c-3de5f045836d for instance fec3661d-93ec-46ac-9d30-188e8863b110 on hv-cinder-85069 Jul 21 22:38:52.829708 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-d57f889a-7659-4b43-a5cb-3703a79b918e req-4812718a-1997-4e23-b900-691e0b80914c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.295697 Jul 21 22:38:52.831846 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 310/665] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:52.861141 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2388f6a9-a2c3-4a4a-8537-edf670c26f07 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:52.863371 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2388f6a9-a2c3-4a4a-8537-edf670c26f07 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:52.870512 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2388f6a9-a2c3-4a4a-8537-edf670c26f07 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.871489 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2388f6a9-a2c3-4a4a-8537-edf670c26f07 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.872924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2388f6a9-a2c3-4a4a-8537-edf670c26f07 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.874301 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2388f6a9-a2c3-4a4a-8537-edf670c26f07 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:53.074807 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2388f6a9-a2c3-4a4a-8537-edf670c26f07 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:53.087214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2388f6a9-a2c3-4a4a-8537-edf670c26f07 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1363 microversion: 2.1 time: 0.233010 Jul 21 22:38:53.089639 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 356/666] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:52 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:53.514182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-55d5f3fc-cd7a-4f87-b196-cdc217b626c8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:53.516452 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-55d5f3fc-cd7a-4f87-b196-cdc217b626c8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:53.538380 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-55d5f3fc-cd7a-4f87-b196-cdc217b626c8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:53.539490 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-55d5f3fc-cd7a-4f87-b196-cdc217b626c8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:53.541471 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-55d5f3fc-cd7a-4f87-b196-cdc217b626c8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:53.542344 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-55d5f3fc-cd7a-4f87-b196-cdc217b626c8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:53.742348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-55d5f3fc-cd7a-4f87-b196-cdc217b626c8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:53.751854 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-55d5f3fc-cd7a-4f87-b196-cdc217b626c8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:53.753360 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-55d5f3fc-cd7a-4f87-b196-cdc217b626c8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:53.754515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-55d5f3fc-cd7a-4f87-b196-cdc217b626c8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.247695 Jul 21 22:38:53.766078 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 311/667] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:53 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:54.105911 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4864805e-1392-4313-b6cc-16ee57fb82a2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:54.106602 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4864805e-1392-4313-b6cc-16ee57fb82a2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:54.113488 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4864805e-1392-4313-b6cc-16ee57fb82a2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:54.113932 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4864805e-1392-4313-b6cc-16ee57fb82a2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.114693 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4864805e-1392-4313-b6cc-16ee57fb82a2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:54.115150 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4864805e-1392-4313-b6cc-16ee57fb82a2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.254352 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4864805e-1392-4313-b6cc-16ee57fb82a2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:54.262508 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4864805e-1392-4313-b6cc-16ee57fb82a2 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1363 microversion: 2.1 time: 0.160058 Jul 21 22:38:54.263462 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 357/668] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:54 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:54.775392 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a8ebba6b-b1d5-4c4a-b019-fe9a7d231f62 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:54.776063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a8ebba6b-b1d5-4c4a-b019-fe9a7d231f62 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:54.784196 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:54.785907 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=10 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:54.789656 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a8ebba6b-b1d5-4c4a-b019-fe9a7d231f62 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:54.790410 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a8ebba6b-b1d5-4c4a-b019-fe9a7d231f62 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.791785 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a8ebba6b-b1d5-4c4a-b019-fe9a7d231f62 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:54.792465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a8ebba6b-b1d5-4c4a-b019-fe9a7d231f62 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.848237 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-776f43ae-984e-4606-91c6-c11507898bfb req-ef744c58-80ab-4ca5-968c-89e7dd04b4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17eec69-e042-4b07-92e3-81b8c2710904", "name": "network-vif-plugged", "status": "completed", "tag": "3fd9e5c7-12f2-4318-9993-a73043acaac8"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:54.874810 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:54.879566 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-776f43ae-984e-4606-91c6-c11507898bfb req-ef744c58-80ab-4ca5-968c-89e7dd04b4e0 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:54.880293 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-776f43ae-984e-4606-91c6-c11507898bfb req-ef744c58-80ab-4ca5-968c-89e7dd04b4e0 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.907182 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-776f43ae-984e-4606-91c6-c11507898bfb req-ef744c58-80ab-4ca5-968c-89e7dd04b4e0 service nova] Creating event network-vif-plugged:3fd9e5c7-12f2-4318-9993-a73043acaac8 for instance e17eec69-e042-4b07-92e3-81b8c2710904 on hv-cinder-85069 Jul 21 22:38:54.916628 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-776f43ae-984e-4606-91c6-c11507898bfb req-ef744c58-80ab-4ca5-968c-89e7dd04b4e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069017 Jul 21 22:38:54.919364 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 358/669] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:55.033887 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a8ebba6b-b1d5-4c4a-b019-fe9a7d231f62 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:55.043727 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a8ebba6b-b1d5-4c4a-b019-fe9a7d231f62 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:55.046104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a8ebba6b-b1d5-4c4a-b019-fe9a7d231f62 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:55.047978 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a8ebba6b-b1d5-4c4a-b019-fe9a7d231f62 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.277635 Jul 21 22:38:55.048974 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 312/670] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:54 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:55.281698 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-765e8094-cbff-4091-87c2-859c5599a57d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:55.282275 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-765e8094-cbff-4091-87c2-859c5599a57d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:55.293262 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-765e8094-cbff-4091-87c2-859c5599a57d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:55.293769 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-765e8094-cbff-4091-87c2-859c5599a57d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:55.294501 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-765e8094-cbff-4091-87c2-859c5599a57d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:55.294940 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-765e8094-cbff-4091-87c2-859c5599a57d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:55.507082 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-765e8094-cbff-4091-87c2-859c5599a57d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:55.517623 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-765e8094-cbff-4091-87c2-859c5599a57d tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1363 microversion: 2.1 time: 0.240504 Jul 21 22:38:55.520145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 359/671] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:55 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:56.068424 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3de53a0b-eb04-44a9-8c48-ae35b6c2c33f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:56.069007 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3de53a0b-eb04-44a9-8c48-ae35b6c2c33f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:56.075548 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3de53a0b-eb04-44a9-8c48-ae35b6c2c33f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:56.076092 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3de53a0b-eb04-44a9-8c48-ae35b6c2c33f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:56.077395 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3de53a0b-eb04-44a9-8c48-ae35b6c2c33f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:56.079907 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3de53a0b-eb04-44a9-8c48-ae35b6c2c33f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:56.280936 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3de53a0b-eb04-44a9-8c48-ae35b6c2c33f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:56.290738 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3de53a0b-eb04-44a9-8c48-ae35b6c2c33f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:56.293096 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3de53a0b-eb04-44a9-8c48-ae35b6c2c33f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:56.294483 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3de53a0b-eb04-44a9-8c48-ae35b6c2c33f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.230035 Jul 21 22:38:56.295275 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 313/672] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:56 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:38:56.537290 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e2f425cd-719c-4d18-9e0c-a0e238e2f0ec tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:56.538923 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e2f425cd-719c-4d18-9e0c-a0e238e2f0ec tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:56.545504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e2f425cd-719c-4d18-9e0c-a0e238e2f0ec tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:56.546618 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e2f425cd-719c-4d18-9e0c-a0e238e2f0ec tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:56.547715 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e2f425cd-719c-4d18-9e0c-a0e238e2f0ec tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:56.548388 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e2f425cd-719c-4d18-9e0c-a0e238e2f0ec tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:56.722886 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e2f425cd-719c-4d18-9e0c-a0e238e2f0ec tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:56.734020 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e2f425cd-719c-4d18-9e0c-a0e238e2f0ec tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1363 microversion: 2.1 time: 0.199322 Jul 21 22:38:56.737499 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 360/673] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:56 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:57.314876 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-ea2c0c5f-dedf-41a3-b9fd-d76789cdbbfa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:57.315764 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-ea2c0c5f-dedf-41a3-b9fd-d76789cdbbfa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:57.323216 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ea2c0c5f-dedf-41a3-b9fd-d76789cdbbfa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:57.323949 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ea2c0c5f-dedf-41a3-b9fd-d76789cdbbfa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:57.325077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ea2c0c5f-dedf-41a3-b9fd-d76789cdbbfa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:57.325740 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ea2c0c5f-dedf-41a3-b9fd-d76789cdbbfa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:57.529900 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-ea2c0c5f-dedf-41a3-b9fd-d76789cdbbfa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:57.543695 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-ea2c0c5f-dedf-41a3-b9fd-d76789cdbbfa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:57.547022 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-ea2c0c5f-dedf-41a3-b9fd-d76789cdbbfa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:57.549131 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-ea2c0c5f-dedf-41a3-b9fd-d76789cdbbfa tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.239285 Jul 21 22:38:57.563090 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 314/674] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:57 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:57.751853 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c1e67656-a581-487d-9a6a-47687ff0038f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:57.752699 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c1e67656-a581-487d-9a6a-47687ff0038f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:57.759350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c1e67656-a581-487d-9a6a-47687ff0038f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:57.760044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c1e67656-a581-487d-9a6a-47687ff0038f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:57.760896 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c1e67656-a581-487d-9a6a-47687ff0038f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:57.761391 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c1e67656-a581-487d-9a6a-47687ff0038f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:57.987734 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c1e67656-a581-487d-9a6a-47687ff0038f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:57.998683 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c1e67656-a581-487d-9a6a-47687ff0038f tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1553 microversion: 2.1 time: 0.249026 Jul 21 22:38:57.999943 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 361/675] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:57 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:58.017291 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-79288789-8d1b-4300-a086-803d840c188a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:58.018104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-79288789-8d1b-4300-a086-803d840c188a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:58.026894 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-79288789-8d1b-4300-a086-803d840c188a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.027672 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-79288789-8d1b-4300-a086-803d840c188a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.028733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-79288789-8d1b-4300-a086-803d840c188a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.029398 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-79288789-8d1b-4300-a086-803d840c188a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.118032 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-79288789-8d1b-4300-a086-803d840c188a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106272 Jul 21 22:38:58.118633 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 315/676] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jul 21 22:38:58 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:58.574392 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-477b92fd-9109-4be5-a20d-700d9a153383 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:58.575218 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-477b92fd-9109-4be5-a20d-700d9a153383 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:58.595185 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-477b92fd-9109-4be5-a20d-700d9a153383 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.595930 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-477b92fd-9109-4be5-a20d-700d9a153383 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.596877 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-477b92fd-9109-4be5-a20d-700d9a153383 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.597467 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-477b92fd-9109-4be5-a20d-700d9a153383 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.776221 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-477b92fd-9109-4be5-a20d-700d9a153383 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:58.786152 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-477b92fd-9109-4be5-a20d-700d9a153383 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:58.788250 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-477b92fd-9109-4be5-a20d-700d9a153383 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:58.789993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-477b92fd-9109-4be5-a20d-700d9a153383 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.220172 Jul 21 22:38:58.791127 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 362/677] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:58 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:38:59.524501 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-b274d4a4-21ec-4f97-ae8e-bfc5206ea668 req-3dd1c540-42f2-4bb2-b128-eea71204ca1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17eec69-e042-4b07-92e3-81b8c2710904", "tag": "3fd9e5c7-12f2-4318-9993-a73043acaac8"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:59.544591 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-b274d4a4-21ec-4f97-ae8e-bfc5206ea668 req-3dd1c540-42f2-4bb2-b128-eea71204ca1f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:59.545657 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-b274d4a4-21ec-4f97-ae8e-bfc5206ea668 req-3dd1c540-42f2-4bb2-b128-eea71204ca1f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:59.559746 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-b274d4a4-21ec-4f97-ae8e-bfc5206ea668 req-3dd1c540-42f2-4bb2-b128-eea71204ca1f service nova] Creating event network-changed:3fd9e5c7-12f2-4318-9993-a73043acaac8 for instance e17eec69-e042-4b07-92e3-81b8c2710904 on hv-cinder-85069 Jul 21 22:38:59.566518 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-b274d4a4-21ec-4f97-ae8e-bfc5206ea668 req-3dd1c540-42f2-4bb2-b128-eea71204ca1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052929 Jul 21 22:38:59.567658 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 316/678] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:59.812801 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9eb8f1e4-3a79-4935-a8b9-1564733d4bd8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:59.814142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-9eb8f1e4-3a79-4935-a8b9-1564733d4bd8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:59.821678 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9eb8f1e4-3a79-4935-a8b9-1564733d4bd8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:59.822542 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9eb8f1e4-3a79-4935-a8b9-1564733d4bd8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:59.823557 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9eb8f1e4-3a79-4935-a8b9-1564733d4bd8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:59.824223 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9eb8f1e4-3a79-4935-a8b9-1564733d4bd8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.022420 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-9eb8f1e4-3a79-4935-a8b9-1564733d4bd8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:00.034229 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-9eb8f1e4-3a79-4935-a8b9-1564733d4bd8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:00.036573 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-9eb8f1e4-3a79-4935-a8b9-1564733d4bd8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:00.038552 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-9eb8f1e4-3a79-4935-a8b9-1564733d4bd8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.230637 Jul 21 22:39:00.039344 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 363/679] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:38:59 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:00.313604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-901a29e0-8ac9-4a26-9651-af26b8f3659c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:00.314690 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-901a29e0-8ac9-4a26-9651-af26b8f3659c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:00.329876 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-901a29e0-8ac9-4a26-9651-af26b8f3659c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.330334 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-901a29e0-8ac9-4a26-9651-af26b8f3659c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.339754 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-901a29e0-8ac9-4a26-9651-af26b8f3659c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.340337 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-901a29e0-8ac9-4a26-9651-af26b8f3659c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.382241 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-901a29e0-8ac9-4a26-9651-af26b8f3659c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.073666 Jul 21 22:39:00.383428 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 317/680] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:39:00 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:00.532460 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-43be8093-8903-4bda-a0ff-18f9e628e657 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:00.533285 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-43be8093-8903-4bda-a0ff-18f9e628e657 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:00.549401 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43be8093-8903-4bda-a0ff-18f9e628e657 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.550449 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43be8093-8903-4bda-a0ff-18f9e628e657 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.551989 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43be8093-8903-4bda-a0ff-18f9e628e657 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.552914 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43be8093-8903-4bda-a0ff-18f9e628e657 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.613944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-43be8093-8903-4bda-a0ff-18f9e628e657 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments/e50adeb7-d78d-4a57-8bcd-eecd0947a723" status: 200 len: 194 microversion: 2.1 time: 0.091574 Jul 21 22:39:00.615368 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 364/681] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Jul 21 22:39:00 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments/e50adeb7-d78d-4a57-8bcd-eecd0947a723 => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:00.628992 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8ff0a552-95be-4a15-8345-89f525b04f04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:00.630175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-8ff0a552-95be-4a15-8345-89f525b04f04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:00.637152 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8ff0a552-95be-4a15-8345-89f525b04f04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.637910 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8ff0a552-95be-4a15-8345-89f525b04f04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.638924 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8ff0a552-95be-4a15-8345-89f525b04f04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.639604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8ff0a552-95be-4a15-8345-89f525b04f04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.778155 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-8ff0a552-95be-4a15-8345-89f525b04f04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lazy-loading 'services' on Instance uuid 9d750e2e-693a-4313-a846-fbf6c0e646e3 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:39:00.971771 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8ff0a552-95be-4a15-8345-89f525b04f04 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments/e50adeb7-d78d-4a57-8bcd-eecd0947a723" status: 202 len: 0 microversion: 2.1 time: 0.347084 Jul 21 22:39:00.980152 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 318/682] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:39:00 2022] DELETE /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments/e50adeb7-d78d-4a57-8bcd-eecd0947a723 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:39:01.066277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8575abaa-da8a-40b7-a810-cdfec137a805 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:01.066895 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8575abaa-da8a-40b7-a810-cdfec137a805 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:01.077606 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8575abaa-da8a-40b7-a810-cdfec137a805 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:01.078063 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8575abaa-da8a-40b7-a810-cdfec137a805 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:01.078865 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8575abaa-da8a-40b7-a810-cdfec137a805 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:01.079336 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8575abaa-da8a-40b7-a810-cdfec137a805 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:01.267391 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8575abaa-da8a-40b7-a810-cdfec137a805 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:01.288989 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8575abaa-da8a-40b7-a810-cdfec137a805 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:01.290779 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8575abaa-da8a-40b7-a810-cdfec137a805 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:01.292516 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8575abaa-da8a-40b7-a810-cdfec137a805 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.230704 Jul 21 22:39:01.306134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 365/683] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:01 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:02.129499 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2c0c7203-4dc6-428d-bc82-dcb4802c00c3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:02.130083 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2c0c7203-4dc6-428d-bc82-dcb4802c00c3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:02.137677 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2c0c7203-4dc6-428d-bc82-dcb4802c00c3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.138137 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2c0c7203-4dc6-428d-bc82-dcb4802c00c3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.139002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2c0c7203-4dc6-428d-bc82-dcb4802c00c3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.139469 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2c0c7203-4dc6-428d-bc82-dcb4802c00c3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.187723 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2c0c7203-4dc6-428d-bc82-dcb4802c00c3 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments/e61e56fc-d931-47a8-af0c-1314ed219461" status: 200 len: 194 microversion: 2.1 time: 0.063360 Jul 21 22:39:02.188896 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 319/684] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Jul 21 22:39:02 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments/e61e56fc-d931-47a8-af0c-1314ed219461 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:02.198554 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a16f7cdc-2fac-4632-b34b-f0bb388f5f3f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:02.199084 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a16f7cdc-2fac-4632-b34b-f0bb388f5f3f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:02.206354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a16f7cdc-2fac-4632-b34b-f0bb388f5f3f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.207098 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a16f7cdc-2fac-4632-b34b-f0bb388f5f3f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.208909 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a16f7cdc-2fac-4632-b34b-f0bb388f5f3f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.209354 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a16f7cdc-2fac-4632-b34b-f0bb388f5f3f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.304251 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-a16f7cdc-2fac-4632-b34b-f0bb388f5f3f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lazy-loading 'services' on Instance uuid 9d750e2e-693a-4313-a846-fbf6c0e646e3 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:39:02.320410 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7ee66562-9f3e-4ef5-beb6-639071ead468 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:02.322134 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7ee66562-9f3e-4ef5-beb6-639071ead468 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:02.327725 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:02.332912 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7ee66562-9f3e-4ef5-beb6-639071ead468 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.333269 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7ee66562-9f3e-4ef5-beb6-639071ead468 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.334687 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7ee66562-9f3e-4ef5-beb6-639071ead468 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.335342 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7ee66562-9f3e-4ef5-beb6-639071ead468 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.403595 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a16f7cdc-2fac-4632-b34b-f0bb388f5f3f tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments/e61e56fc-d931-47a8-af0c-1314ed219461" status: 202 len: 0 microversion: 2.1 time: 0.208948 Jul 21 22:39:02.404711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 366/685] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:39:02 2022] DELETE /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments/e61e56fc-d931-47a8-af0c-1314ed219461 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:39:02.541086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7ee66562-9f3e-4ef5-beb6-639071ead468 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:02.551924 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7ee66562-9f3e-4ef5-beb6-639071ead468 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:02.554010 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7ee66562-9f3e-4ef5-beb6-639071ead468 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:02.555541 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7ee66562-9f3e-4ef5-beb6-639071ead468 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.244620 Jul 21 22:39:02.556597 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 320/686] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:02 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:39:03.577807 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-89bc2764-688a-4400-b4b8-5b31d82114ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:03.579005 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-89bc2764-688a-4400-b4b8-5b31d82114ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:03.586396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-89bc2764-688a-4400-b4b8-5b31d82114ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:03.586853 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-89bc2764-688a-4400-b4b8-5b31d82114ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:03.587661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-89bc2764-688a-4400-b4b8-5b31d82114ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:03.588102 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-89bc2764-688a-4400-b4b8-5b31d82114ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:03.759876 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-89bc2764-688a-4400-b4b8-5b31d82114ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:03.768609 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-89bc2764-688a-4400-b4b8-5b31d82114ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:03.770131 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-89bc2764-688a-4400-b4b8-5b31d82114ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:03.771340 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-89bc2764-688a-4400-b4b8-5b31d82114ed tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.199910 Jul 21 22:39:03.771900 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 367/687] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:03 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:04.790144 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1bb13f52-c981-4e65-ab68-b38729c93b88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:04.790777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1bb13f52-c981-4e65-ab68-b38729c93b88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:04.797485 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1bb13f52-c981-4e65-ab68-b38729c93b88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:04.797880 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1bb13f52-c981-4e65-ab68-b38729c93b88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:04.798651 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1bb13f52-c981-4e65-ab68-b38729c93b88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:04.799113 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1bb13f52-c981-4e65-ab68-b38729c93b88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:04.939758 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1bb13f52-c981-4e65-ab68-b38729c93b88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:04.948594 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1bb13f52-c981-4e65-ab68-b38729c93b88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:04.950196 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1bb13f52-c981-4e65-ab68-b38729c93b88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:04.951418 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1bb13f52-c981-4e65-ab68-b38729c93b88 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.165180 Jul 21 22:39:04.952032 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 321/688] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:04 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:05.969826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-404df87d-4eb9-4be9-9d82-802025542cf6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:05.970276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-404df87d-4eb9-4be9-9d82-802025542cf6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:05.976617 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-404df87d-4eb9-4be9-9d82-802025542cf6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:05.977064 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-404df87d-4eb9-4be9-9d82-802025542cf6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:05.978098 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-404df87d-4eb9-4be9-9d82-802025542cf6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:05.978394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-404df87d-4eb9-4be9-9d82-802025542cf6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.144118 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-404df87d-4eb9-4be9-9d82-802025542cf6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:06.152750 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-404df87d-4eb9-4be9-9d82-802025542cf6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:06.154342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-404df87d-4eb9-4be9-9d82-802025542cf6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:06.156002 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-404df87d-4eb9-4be9-9d82-802025542cf6 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1740 microversion: 2.20 time: 0.189955 Jul 21 22:39:06.170517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 368/689] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:05 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:06.764153 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-172d8803-7815-4f9f-990f-3d952b7c44f5 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:06.765984 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-172d8803-7815-4f9f-990f-3d952b7c44f5 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:06.772730 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-172d8803-7815-4f9f-990f-3d952b7c44f5 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.773172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-172d8803-7815-4f9f-990f-3d952b7c44f5 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.773948 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-172d8803-7815-4f9f-990f-3d952b7c44f5 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.774382 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-172d8803-7815-4f9f-990f-3d952b7c44f5 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.805789 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-172d8803-7815-4f9f-990f-3d952b7c44f5 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045620 Jul 21 22:39:06.806354 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 322/690] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:39:06 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:39:06.917157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-bb8f3756-f69e-474f-a728-d87bb484e6b0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:06.918146 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-bb8f3756-f69e-474f-a728-d87bb484e6b0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:06.925263 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bb8f3756-f69e-474f-a728-d87bb484e6b0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.925710 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bb8f3756-f69e-474f-a728-d87bb484e6b0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.926593 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bb8f3756-f69e-474f-a728-d87bb484e6b0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.927048 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bb8f3756-f69e-474f-a728-d87bb484e6b0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.958022 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-bb8f3756-f69e-474f-a728-d87bb484e6b0 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044872 Jul 21 22:39:06.958608 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 369/691] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:39:06 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:39:07.018820 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0f446be1-a2df-40a8-89fe-3b05c98c5ed8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:07.019327 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0f446be1-a2df-40a8-89fe-3b05c98c5ed8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:07.025340 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f446be1-a2df-40a8-89fe-3b05c98c5ed8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.025782 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f446be1-a2df-40a8-89fe-3b05c98c5ed8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.026545 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f446be1-a2df-40a8-89fe-3b05c98c5ed8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.026978 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0f446be1-a2df-40a8-89fe-3b05c98c5ed8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.053542 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0f446be1-a2df-40a8-89fe-3b05c98c5ed8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:39:07.123733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0f446be1-a2df-40a8-89fe-3b05c98c5ed8 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 204 len: 0 microversion: 2.1 time: 0.108900 Jul 21 22:39:07.124658 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 323/692] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:39:07 2022] DELETE /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:39:07.132689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e8252cc8-f3f7-4025-92f5-995717372504 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:07.133294 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e8252cc8-f3f7-4025-92f5-995717372504 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:07.139124 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8252cc8-f3f7-4025-92f5-995717372504 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.139765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8252cc8-f3f7-4025-92f5-995717372504 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.141024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8252cc8-f3f7-4025-92f5-995717372504 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.141454 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8252cc8-f3f7-4025-92f5-995717372504 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.175417 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a27a8d7f-a8a3-4563-b10c-b362e655905d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:07.176031 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a27a8d7f-a8a3-4563-b10c-b362e655905d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:07.182414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a27a8d7f-a8a3-4563-b10c-b362e655905d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.182870 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a27a8d7f-a8a3-4563-b10c-b362e655905d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.183690 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a27a8d7f-a8a3-4563-b10c-b362e655905d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.184132 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a27a8d7f-a8a3-4563-b10c-b362e655905d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.322393 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e8252cc8-f3f7-4025-92f5-995717372504 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:07.332091 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e8252cc8-f3f7-4025-92f5-995717372504 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1673 microversion: 2.1 time: 0.202994 Jul 21 22:39:07.333061 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 370/693] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:07 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:07.352170 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a27a8d7f-a8a3-4563-b10c-b362e655905d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:07.360637 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a27a8d7f-a8a3-4563-b10c-b362e655905d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:07.362148 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a27a8d7f-a8a3-4563-b10c-b362e655905d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:07.363367 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a27a8d7f-a8a3-4563-b10c-b362e655905d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1722 microversion: 2.20 time: 0.193520 Jul 21 22:39:07.363935 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 324/694] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:07 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:39:08.350660 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2ae44b22-4d0a-4d2b-b5e9-5f16d51a8f6c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:08.351334 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2ae44b22-4d0a-4d2b-b5e9-5f16d51a8f6c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:08.353328 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=68 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:08.358843 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2ae44b22-4d0a-4d2b-b5e9-5f16d51a8f6c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:08.359251 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2ae44b22-4d0a-4d2b-b5e9-5f16d51a8f6c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:08.360007 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2ae44b22-4d0a-4d2b-b5e9-5f16d51a8f6c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:08.360435 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2ae44b22-4d0a-4d2b-b5e9-5f16d51a8f6c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:08.363144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:08.381761 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7c919e89-8292-4688-bb94-2734c343340b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:08.382381 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7c919e89-8292-4688-bb94-2734c343340b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:08.389029 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c919e89-8292-4688-bb94-2734c343340b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:08.390129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c919e89-8292-4688-bb94-2734c343340b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:08.391217 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c919e89-8292-4688-bb94-2734c343340b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:08.391659 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c919e89-8292-4688-bb94-2734c343340b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:08.410713 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:08.547445 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2ae44b22-4d0a-4d2b-b5e9-5f16d51a8f6c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:08.554852 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2ae44b22-4d0a-4d2b-b5e9-5f16d51a8f6c tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1673 microversion: 2.1 time: 0.208719 Jul 21 22:39:08.555458 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 371/695] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:08 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:08.571593 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7c919e89-8292-4688-bb94-2734c343340b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:08.580595 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7c919e89-8292-4688-bb94-2734c343340b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:08.582079 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7c919e89-8292-4688-bb94-2734c343340b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:08.583260 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7c919e89-8292-4688-bb94-2734c343340b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1722 microversion: 2.20 time: 0.205427 Jul 21 22:39:08.583811 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 325/696] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:08 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:39:09.571611 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1ef94f9d-712d-4d56-850b-d8481524031a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:09.572227 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1ef94f9d-712d-4d56-850b-d8481524031a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:09.578858 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1ef94f9d-712d-4d56-850b-d8481524031a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.579342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1ef94f9d-712d-4d56-850b-d8481524031a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.580113 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1ef94f9d-712d-4d56-850b-d8481524031a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.580551 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1ef94f9d-712d-4d56-850b-d8481524031a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.601481 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-121e93cf-4486-4629-a2ee-30a55b53a20c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:09.602082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-121e93cf-4486-4629-a2ee-30a55b53a20c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:09.609666 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-121e93cf-4486-4629-a2ee-30a55b53a20c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.610124 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-121e93cf-4486-4629-a2ee-30a55b53a20c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.610938 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-121e93cf-4486-4629-a2ee-30a55b53a20c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.611419 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-121e93cf-4486-4629-a2ee-30a55b53a20c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.798068 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1ef94f9d-712d-4d56-850b-d8481524031a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:09.807903 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1ef94f9d-712d-4d56-850b-d8481524031a tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1673 microversion: 2.1 time: 0.240026 Jul 21 22:39:09.811106 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 372/697] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:09 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1673 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:09.835226 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-121e93cf-4486-4629-a2ee-30a55b53a20c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:09.845071 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-121e93cf-4486-4629-a2ee-30a55b53a20c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:09.846444 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-121e93cf-4486-4629-a2ee-30a55b53a20c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:09.847664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-121e93cf-4486-4629-a2ee-30a55b53a20c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1722 microversion: 2.20 time: 0.250047 Jul 21 22:39:09.848228 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 326/698] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:09 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:10.472390 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-37cab3b6-7e44-4780-a2e1-08e84b50a20a req-dcba6079-8f4f-47cc-826f-5553e817e633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec3661d-93ec-46ac-9d30-188e8863b110", "name": "network-vif-unplugged", "status": "completed", "tag": "a6bccf3e-2937-4ac6-854c-3de5f045836d"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:10.481651 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-37cab3b6-7e44-4780-a2e1-08e84b50a20a req-dcba6079-8f4f-47cc-826f-5553e817e633 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.482340 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-37cab3b6-7e44-4780-a2e1-08e84b50a20a req-dcba6079-8f4f-47cc-826f-5553e817e633 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.496137 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.compute.server_external_events [req-37cab3b6-7e44-4780-a2e1-08e84b50a20a req-dcba6079-8f4f-47cc-826f-5553e817e633 service nova] Unable to find a host for instance fec3661d-93ec-46ac-9d30-188e8863b110. Dropping event network-vif-unplugged {{(pid=124498) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 22:39:10.497263 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-37cab3b6-7e44-4780-a2e1-08e84b50a20a req-dcba6079-8f4f-47cc-826f-5553e817e633 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029075 Jul 21 22:39:10.498393 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 373/699] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 21 22:39:10.832109 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0c45b1c0-15cb-4326-ad24-137233758286 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:10.832836 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0c45b1c0-15cb-4326-ad24-137233758286 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:10.839684 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0c45b1c0-15cb-4326-ad24-137233758286 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.840295 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0c45b1c0-15cb-4326-ad24-137233758286 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.841076 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0c45b1c0-15cb-4326-ad24-137233758286 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.841691 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0c45b1c0-15cb-4326-ad24-137233758286 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.868234 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8a313f07-2f3c-45c5-bd67-65e8905fa461 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:10.869523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8a313f07-2f3c-45c5-bd67-65e8905fa461 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:10.877661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8a313f07-2f3c-45c5-bd67-65e8905fa461 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.878662 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8a313f07-2f3c-45c5-bd67-65e8905fa461 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.880337 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8a313f07-2f3c-45c5-bd67-65e8905fa461 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.880776 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8a313f07-2f3c-45c5-bd67-65e8905fa461 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.914979 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-0c45b1c0-15cb-4326-ad24-137233758286 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee22783b3234c4f905fedce7d59f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54636d00282483381454b9be56a43b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:10.923527 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0c45b1c0-15cb-4326-ad24-137233758286 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 200 len: 1606 microversion: 2.1 time: 0.095124 Jul 21 22:39:10.924468 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 327/700] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:10 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 1606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:11.038633 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8a313f07-2f3c-45c5-bd67-65e8905fa461 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:11.048444 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-769f4186-2cbc-418d-b0af-d56e6db7948d req-ab394e65-a1a1-48dd-85ab-cc8fb4f5a117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d750e2e-693a-4313-a846-fbf6c0e646e3", "name": "network-vif-deleted", "tag": "dfb50e65-fc1d-4362-ad4b-f3df94db538d"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:11.053773 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8a313f07-2f3c-45c5-bd67-65e8905fa461 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:11.056736 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8a313f07-2f3c-45c5-bd67-65e8905fa461 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:11.058254 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8a313f07-2f3c-45c5-bd67-65e8905fa461 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1665 microversion: 2.20 time: 0.195863 Jul 21 22:39:11.073725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 374/701] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:10 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1665 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:11.074995 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-769f4186-2cbc-418d-b0af-d56e6db7948d req-ab394e65-a1a1-48dd-85ab-cc8fb4f5a117 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.075500 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-769f4186-2cbc-418d-b0af-d56e6db7948d req-ab394e65-a1a1-48dd-85ab-cc8fb4f5a117 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.082878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1c124af7-5fe0-44bb-b0f1-c769fee944b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ef99b70-fc02-46ec-89c6-fb83a07816a6"}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:11.086220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1c124af7-5fe0-44bb-b0f1-c769fee944b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:11.093324 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c124af7-5fe0-44bb-b0f1-c769fee944b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.094157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c124af7-5fe0-44bb-b0f1-c769fee944b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.094285 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-769f4186-2cbc-418d-b0af-d56e6db7948d req-ab394e65-a1a1-48dd-85ab-cc8fb4f5a117 service nova] Creating event network-vif-deleted:dfb50e65-fc1d-4362-ad4b-f3df94db538d for instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 on hv-cinder-85069 Jul 21 22:39:11.095342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c124af7-5fe0-44bb-b0f1-c769fee944b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.096022 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1c124af7-5fe0-44bb-b0f1-c769fee944b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.100902 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-769f4186-2cbc-418d-b0af-d56e6db7948d req-ab394e65-a1a1-48dd-85ab-cc8fb4f5a117 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057657 Jul 21 22:39:11.101600 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 328/702] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:39:11.493369 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1c124af7-5fe0-44bb-b0f1-c769fee944b4 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "POST /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.417182 Jul 21 22:39:11.494781 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 375/703] 10.222.0.58 () {62 vars in 1363 bytes} [Thu Jul 21 22:39:11 2022] POST /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/os-volume_attachments => generated 188 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:11.717870 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9dd5ee05-1f5e-4736-80e4-75a285b7f737 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:11.719552 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-9dd5ee05-1f5e-4736-80e4-75a285b7f737 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:11.731989 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9dd5ee05-1f5e-4736-80e4-75a285b7f737 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.732795 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9dd5ee05-1f5e-4736-80e4-75a285b7f737 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.734615 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9dd5ee05-1f5e-4736-80e4-75a285b7f737 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.735667 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9dd5ee05-1f5e-4736-80e4-75a285b7f737 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.952477 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-89dd91cc-7aab-4b2b-a675-faef05f8b302 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:11.955303 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-89dd91cc-7aab-4b2b-a675-faef05f8b302 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:11.969532 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-89dd91cc-7aab-4b2b-a675-faef05f8b302 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.970316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-89dd91cc-7aab-4b2b-a675-faef05f8b302 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.972159 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-89dd91cc-7aab-4b2b-a675-faef05f8b302 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.972938 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-89dd91cc-7aab-4b2b-a675-faef05f8b302 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.010528 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-89dd91cc-7aab-4b2b-a675-faef05f8b302 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] HTTP exception thrown: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-89dd91cc-7aab-4b2b-a675-faef05f8b302 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Request method failure captured: Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 HTTP/1.1 Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQi1Xc4z98kJuhUF6P8uCkoK6PbSXq6CQiVJBBqE3LFRIUraXG-GV3-7HuM1a3NR4N42DH0AfnRU8n_5W3BAFkW2pbdQDd9xxAIr7Zzpd0uRx4yxCQnmZCe0SdPrVCfKu-p6_WXh_efrRbSPcaATh-kAvY8egKOlfj_Qb4lJXhDJf4 Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:39:12.014993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d54636d00282483381454b9be56a43b5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d54636d00282483381454b9be56a43b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: 1ee22783b3234c4f905fedce7d59f01d Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:12.018316 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '9d750e2e-693a-4313-a846-fbf6c0e646e3'} Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:12.019961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:12.022664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:12.025055 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-89dd91cc-7aab-4b2b-a675-faef05f8b302 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Returning 404 to user: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:12.025055 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-89dd91cc-7aab-4b2b-a675-faef05f8b302 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 404 len: 111 microversion: 2.1 time: 0.078862 Jul 21 22:39:12.025328 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 376/704] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:11 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:12.036273 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0d83f694-581b-497c-a00a-2fc6c6eb3927 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '.version_select at 0x7f47e68193a0>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:12.072462 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0d83f694-581b-497c-a00a-2fc6c6eb3927 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746645662" status: 202 len: 0 microversion: 2.1 time: 0.045716 Jul 21 22:39:12.073208 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 377/705] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jul 21 22:39:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746645662 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:39:12.119266 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-9dd5ee05-1f5e-4736-80e4-75a285b7f737 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/os-volume_attachments/5ef99b70-fc02-46ec-89c6-fb83a07816a6" status: 202 len: 0 microversion: 2.20 time: 0.409074 Jul 21 22:39:12.120807 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 329/706] 10.222.0.58 () {60 vars in 1456 bytes} [Thu Jul 21 22:39:11 2022] DELETE /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/os-volume_attachments/5ef99b70-fc02-46ec-89c6-fb83a07816a6 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:39:12.190960 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-855374fd-8b90-4fc0-9f3f-4d21d63154cc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:12.191558 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-855374fd-8b90-4fc0-9f3f-4d21d63154cc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:12.197681 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-855374fd-8b90-4fc0-9f3f-4d21d63154cc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.198417 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-855374fd-8b90-4fc0-9f3f-4d21d63154cc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.199380 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-855374fd-8b90-4fc0-9f3f-4d21d63154cc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.199970 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-855374fd-8b90-4fc0-9f3f-4d21d63154cc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.299312 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-855374fd-8b90-4fc0-9f3f-4d21d63154cc tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "POST /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/action" status: 202 len: 0 microversion: 2.20 time: 0.110474 Jul 21 22:39:12.304841 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 378/707] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jul 21 22:39:12 2022] POST /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:39:12.308980 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-008f3804-2679-4c32-8de1-615ab98325a7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:12.309831 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-008f3804-2679-4c32-8de1-615ab98325a7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:12.324089 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-008f3804-2679-4c32-8de1-615ab98325a7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.324925 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-008f3804-2679-4c32-8de1-615ab98325a7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.325936 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-008f3804-2679-4c32-8de1-615ab98325a7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.326823 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-008f3804-2679-4c32-8de1-615ab98325a7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.541623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-008f3804-2679-4c32-8de1-615ab98325a7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:12.551361 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-008f3804-2679-4c32-8de1-615ab98325a7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:12.553115 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-008f3804-2679-4c32-8de1-615ab98325a7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:12.554443 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-008f3804-2679-4c32-8de1-615ab98325a7 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1673 microversion: 2.20 time: 0.249751 Jul 21 22:39:12.567501 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 330/708] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:12 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1673 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:39:13.577100 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f506e749-81cf-4e15-ab42-f2f10c44d1be tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:13.578124 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f506e749-81cf-4e15-ab42-f2f10c44d1be tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:13.584362 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f506e749-81cf-4e15-ab42-f2f10c44d1be tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:13.585541 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f506e749-81cf-4e15-ab42-f2f10c44d1be tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:13.586429 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f506e749-81cf-4e15-ab42-f2f10c44d1be tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:13.586975 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f506e749-81cf-4e15-ab42-f2f10c44d1be tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:13.741123 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f506e749-81cf-4e15-ab42-f2f10c44d1be tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:13.753315 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f506e749-81cf-4e15-ab42-f2f10c44d1be tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:13.755315 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f506e749-81cf-4e15-ab42-f2f10c44d1be tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:13.756967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f506e749-81cf-4e15-ab42-f2f10c44d1be tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.186250 Jul 21 22:39:13.757750 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 379/709] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:13 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:14.777574 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3aa3c62e-6ec4-43e7-84d1-4d1105838283 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:14.778355 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3aa3c62e-6ec4-43e7-84d1-4d1105838283 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:14.786586 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3aa3c62e-6ec4-43e7-84d1-4d1105838283 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:14.787435 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3aa3c62e-6ec4-43e7-84d1-4d1105838283 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:14.789771 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3aa3c62e-6ec4-43e7-84d1-4d1105838283 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:14.790506 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3aa3c62e-6ec4-43e7-84d1-4d1105838283 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:14.982346 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3aa3c62e-6ec4-43e7-84d1-4d1105838283 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:14.991822 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3aa3c62e-6ec4-43e7-84d1-4d1105838283 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:14.993720 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3aa3c62e-6ec4-43e7-84d1-4d1105838283 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:14.995223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3aa3c62e-6ec4-43e7-84d1-4d1105838283 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.222178 Jul 21 22:39:14.996540 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 331/710] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:14 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:15.153471 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-af63c2da-30ab-4aba-a71c-3c5f21989013 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:15.154101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-af63c2da-30ab-4aba-a71c-3c5f21989013 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:15.165346 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-af63c2da-30ab-4aba-a71c-3c5f21989013 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.165708 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-af63c2da-30ab-4aba-a71c-3c5f21989013 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.166502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-af63c2da-30ab-4aba-a71c-3c5f21989013 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.166939 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-af63c2da-30ab-4aba-a71c-3c5f21989013 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.183955 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-af63c2da-30ab-4aba-a71c-3c5f21989013 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] HTTP exception thrown: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-af63c2da-30ab-4aba-a71c-3c5f21989013 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Request method failure captured: Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: DELETE /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 HTTP/1.1 Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQi1Xc4z98kJuhUF6P8uCkoK6PbSXq6CQiVJBBqE3LFRIUraXG-GV3-7HuM1a3NR4N42DH0AfnRU8n_5W3BAFkW2pbdQDd9xxAIr7Zzpd0uRx4yxCQnmZCe0SdPrVCfKu-p6_WXh_efrRbSPcaATh-kAvY8egKOlfj_Qb4lJXhDJf4 Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:39:15.184861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d54636d00282483381454b9be56a43b5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d54636d00282483381454b9be56a43b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: 1ee22783b3234c4f905fedce7d59f01d Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:15.186949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '9d750e2e-693a-4313-a846-fbf6c0e646e3'} Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:15.187973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:15.189416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.191812 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-af63c2da-30ab-4aba-a71c-3c5f21989013 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Returning 404 to user: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:15.192693 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-af63c2da-30ab-4aba-a71c-3c5f21989013 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 404 len: 111 microversion: 2.1 time: 0.046113 Jul 21 22:39:15.193525 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 380/711] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:39:15 2022] DELETE /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:15.202844 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1d3aa2f0-2227-4c7f-8b18-f2b9d1320ee1 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:15.203711 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1d3aa2f0-2227-4c7f-8b18-f2b9d1320ee1 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: 9d750e2e-693a-4313-a846-fbf6c0e646e3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:15.211103 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1d3aa2f0-2227-4c7f-8b18-f2b9d1320ee1 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.211798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1d3aa2f0-2227-4c7f-8b18-f2b9d1320ee1 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.212991 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1d3aa2f0-2227-4c7f-8b18-f2b9d1320ee1 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.213585 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1d3aa2f0-2227-4c7f-8b18-f2b9d1320ee1 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.231806 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-1d3aa2f0-2227-4c7f-8b18-f2b9d1320ee1 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] HTTP exception thrown: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1d3aa2f0-2227-4c7f-8b18-f2b9d1320ee1 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Request method failure captured: Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 HTTP/1.1 Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQi1Xc4z98kJuhUF6P8uCkoK6PbSXq6CQiVJBBqE3LFRIUraXG-GV3-7HuM1a3NR4N42DH0AfnRU8n_5W3BAFkW2pbdQDd9xxAIr7Zzpd0uRx4yxCQnmZCe0SdPrVCfKu-p6_WXh_efrRbSPcaATh-kAvY8egKOlfj_Qb4lJXhDJf4 Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:39:15.235233 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d54636d00282483381454b9be56a43b5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d54636d00282483381454b9be56a43b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 1ee22783b3234c4f905fedce7d59f01d Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:15.236808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': '9d750e2e-693a-4313-a846-fbf6c0e646e3'} Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:15.237662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. Jul 21 22:39:15.239034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.241543 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1d3aa2f0-2227-4c7f-8b18-f2b9d1320ee1 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Returning 404 to user: Instance 9d750e2e-693a-4313-a846-fbf6c0e646e3 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:15.242588 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1d3aa2f0-2227-4c7f-8b18-f2b9d1320ee1 tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3" status: 404 len: 111 microversion: 2.1 time: 0.044956 Jul 21 22:39:15.250400 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 332/712] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:15 2022] GET /compute/v2.1/servers/9d750e2e-693a-4313-a846-fbf6c0e646e3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:16.013817 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-227d961b-93a9-4a95-922b-909c855642b8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:16.015074 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-227d961b-93a9-4a95-922b-909c855642b8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:16.022071 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-227d961b-93a9-4a95-922b-909c855642b8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.022887 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-227d961b-93a9-4a95-922b-909c855642b8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.023926 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-227d961b-93a9-4a95-922b-909c855642b8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.024463 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-227d961b-93a9-4a95-922b-909c855642b8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.178874 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-227d961b-93a9-4a95-922b-909c855642b8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:16.188761 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-227d961b-93a9-4a95-922b-909c855642b8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:16.190269 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-227d961b-93a9-4a95-922b-909c855642b8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:16.191467 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-227d961b-93a9-4a95-922b-909c855642b8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.181666 Jul 21 22:39:16.192027 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 381/713] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:16 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:16.448266 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-14709789-f783-4415-8513-5d71506dd26b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:16.448975 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-14709789-f783-4415-8513-5d71506dd26b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:16.456744 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-14709789-f783-4415-8513-5d71506dd26b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.457187 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-14709789-f783-4415-8513-5d71506dd26b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.457963 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-14709789-f783-4415-8513-5d71506dd26b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.458399 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-14709789-f783-4415-8513-5d71506dd26b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.474976 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-14709789-f783-4415-8513-5d71506dd26b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] HTTP exception thrown: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-14709789-f783-4415-8513-5d71506dd26b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Request method failure captured: Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: DELETE /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 HTTP/1.1 Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQi1Xc4z98kJuhUF6P8uCkoK6PbSXq6CQiVJBBqE3LFRIUraXG-GV3-7HuM1a3NR4N42DH0AfnRU8n_5W3BAFkW2pbdQDd9xxAIr7Zzpd0uRx4yxCQnmZCe0SdPrVCfKu-p6_WXh_efrRbSPcaATh-kAvY8egKOlfj_Qb4lJXhDJf4 Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:39:16.476647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d54636d00282483381454b9be56a43b5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d54636d00282483381454b9be56a43b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 1ee22783b3234c4f905fedce7d59f01d Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:39:16.478324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'ffa905ed-e5e9-4837-8aca-77fff9f6d722'} Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:16.480149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:39:16.481607 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:16.484794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-14709789-f783-4415-8513-5d71506dd26b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Returning 404 to user: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:16.485684 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-14709789-f783-4415-8513-5d71506dd26b tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 404 len: 111 microversion: 2.1 time: 0.041359 Jul 21 22:39:16.486271 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 333/714] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:39:16 2022] DELETE /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:16.498589 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3849c7b6-a097-49d5-80d8-6565397334ff tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:16.499831 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3849c7b6-a097-49d5-80d8-6565397334ff tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] [instance: ffa905ed-e5e9-4837-8aca-77fff9f6d722] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:16.508107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3849c7b6-a097-49d5-80d8-6565397334ff tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.508647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3849c7b6-a097-49d5-80d8-6565397334ff tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.509494 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3849c7b6-a097-49d5-80d8-6565397334ff tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.510000 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3849c7b6-a097-49d5-80d8-6565397334ff tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.525213 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-3849c7b6-a097-49d5-80d8-6565397334ff tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] HTTP exception thrown: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3849c7b6-a097-49d5-80d8-6565397334ff tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Request method failure captured: Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 HTTP/1.1 Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQi1Xc4z98kJuhUF6P8uCkoK6PbSXq6CQiVJBBqE3LFRIUraXG-GV3-7HuM1a3NR4N42DH0AfnRU8n_5W3BAFkW2pbdQDd9xxAIr7Zzpd0uRx4yxCQnmZCe0SdPrVCfKu-p6_WXh_efrRbSPcaATh-kAvY8egKOlfj_Qb4lJXhDJf4 Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:39:16.526850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d54636d00282483381454b9be56a43b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d54636d00282483381454b9be56a43b5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d54636d00282483381454b9be56a43b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: d54636d00282483381454b9be56a43b5 Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2023740584 Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: 1ee22783b3234c4f905fedce7d59f01d Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeTestJSON-2023740584-project Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:39:16.528912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'ffa905ed-e5e9-4837-8aca-77fff9f6d722'} Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:16.530519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. Jul 21 22:39:16.532214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:16.533477 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3849c7b6-a097-49d5-80d8-6565397334ff tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] Returning 404 to user: Instance ffa905ed-e5e9-4837-8aca-77fff9f6d722 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:16.533477 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3849c7b6-a097-49d5-80d8-6565397334ff tempest-AttachVolumeTestJSON-2023740584 tempest-AttachVolumeTestJSON-2023740584-project] 10.222.0.58 "GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722" status: 404 len: 111 microversion: 2.1 time: 0.038934 Jul 21 22:39:16.533637 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 382/715] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:16 2022] GET /compute/v2.1/servers/ffa905ed-e5e9-4837-8aca-77fff9f6d722 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:17.216362 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c6b4ade4-7a80-47d9-8aeb-59b07814e730 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:17.217338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c6b4ade4-7a80-47d9-8aeb-59b07814e730 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:17.224236 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c6b4ade4-7a80-47d9-8aeb-59b07814e730 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:17.224975 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c6b4ade4-7a80-47d9-8aeb-59b07814e730 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:17.225948 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c6b4ade4-7a80-47d9-8aeb-59b07814e730 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:17.226846 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c6b4ade4-7a80-47d9-8aeb-59b07814e730 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:17.454440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c6b4ade4-7a80-47d9-8aeb-59b07814e730 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:17.464627 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c6b4ade4-7a80-47d9-8aeb-59b07814e730 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:17.466317 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c6b4ade4-7a80-47d9-8aeb-59b07814e730 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:17.468383 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c6b4ade4-7a80-47d9-8aeb-59b07814e730 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.261397 Jul 21 22:39:17.468956 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 334/716] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:17 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:18.488302 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-77a87d01-ed30-4ad5-a75a-530af5a1368a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:18.488946 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-77a87d01-ed30-4ad5-a75a-530af5a1368a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:18.497726 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77a87d01-ed30-4ad5-a75a-530af5a1368a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:18.500649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77a87d01-ed30-4ad5-a75a-530af5a1368a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:18.504144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77a87d01-ed30-4ad5-a75a-530af5a1368a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:18.507714 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77a87d01-ed30-4ad5-a75a-530af5a1368a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:19.104649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-77a87d01-ed30-4ad5-a75a-530af5a1368a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:19.118245 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-77a87d01-ed30-4ad5-a75a-530af5a1368a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:19.121505 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-77a87d01-ed30-4ad5-a75a-530af5a1368a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:19.125932 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-77a87d01-ed30-4ad5-a75a-530af5a1368a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.640321 Jul 21 22:39:19.147149 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 383/717] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:18 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:20.148324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a7e126d1-9cd9-40a6-a358-b70a14680a7d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:20.149592 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a7e126d1-9cd9-40a6-a358-b70a14680a7d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:20.179150 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7e126d1-9cd9-40a6-a358-b70a14680a7d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:20.180950 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7e126d1-9cd9-40a6-a358-b70a14680a7d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:20.182433 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7e126d1-9cd9-40a6-a358-b70a14680a7d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:20.183190 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a7e126d1-9cd9-40a6-a358-b70a14680a7d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:20.457512 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a7e126d1-9cd9-40a6-a358-b70a14680a7d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:20.476857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a7e126d1-9cd9-40a6-a358-b70a14680a7d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:20.480388 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a7e126d1-9cd9-40a6-a358-b70a14680a7d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:20.481967 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a7e126d1-9cd9-40a6-a358-b70a14680a7d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.339795 Jul 21 22:39:20.484112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 335/718] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:20 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:21.501723 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-50e378d6-3430-438b-9e36-1cf11643dfd9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:21.503111 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-50e378d6-3430-438b-9e36-1cf11643dfd9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:21.517654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50e378d6-3430-438b-9e36-1cf11643dfd9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:21.518596 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50e378d6-3430-438b-9e36-1cf11643dfd9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:21.520410 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50e378d6-3430-438b-9e36-1cf11643dfd9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:21.523669 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50e378d6-3430-438b-9e36-1cf11643dfd9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:22.169209 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-50e378d6-3430-438b-9e36-1cf11643dfd9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:22.190567 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-50e378d6-3430-438b-9e36-1cf11643dfd9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:22.193421 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-50e378d6-3430-438b-9e36-1cf11643dfd9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:22.195085 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-50e378d6-3430-438b-9e36-1cf11643dfd9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.698146 Jul 21 22:39:22.209555 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 384/719] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:21 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:23.217844 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-67d2fbc9-aabe-46ed-9187-28bbc4add472 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:23.219600 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-67d2fbc9-aabe-46ed-9187-28bbc4add472 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:23.237031 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-67d2fbc9-aabe-46ed-9187-28bbc4add472 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:23.237570 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-67d2fbc9-aabe-46ed-9187-28bbc4add472 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:23.238384 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-67d2fbc9-aabe-46ed-9187-28bbc4add472 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:23.239010 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-67d2fbc9-aabe-46ed-9187-28bbc4add472 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:23.502958 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-67d2fbc9-aabe-46ed-9187-28bbc4add472 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:23.511810 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-67d2fbc9-aabe-46ed-9187-28bbc4add472 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:23.513533 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-67d2fbc9-aabe-46ed-9187-28bbc4add472 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:23.517381 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-67d2fbc9-aabe-46ed-9187-28bbc4add472 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.303350 Jul 21 22:39:23.517967 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 336/720] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:23 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:24.535917 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-366330aa-d460-4630-ae8a-019f4681de55 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:24.536512 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-366330aa-d460-4630-ae8a-019f4681de55 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:24.542830 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-366330aa-d460-4630-ae8a-019f4681de55 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:24.543339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-366330aa-d460-4630-ae8a-019f4681de55 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:24.544111 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-366330aa-d460-4630-ae8a-019f4681de55 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:24.544541 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-366330aa-d460-4630-ae8a-019f4681de55 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:24.700878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-366330aa-d460-4630-ae8a-019f4681de55 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:24.709123 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-366330aa-d460-4630-ae8a-019f4681de55 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:24.710637 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-366330aa-d460-4630-ae8a-019f4681de55 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:24.711818 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-366330aa-d460-4630-ae8a-019f4681de55 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.179796 Jul 21 22:39:24.712377 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 385/721] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:24 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:25.730972 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-25a899d8-f9bb-414f-b076-4f96c47b4de8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:25.731566 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-25a899d8-f9bb-414f-b076-4f96c47b4de8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:25.738953 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-25a899d8-f9bb-414f-b076-4f96c47b4de8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:25.739436 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-25a899d8-f9bb-414f-b076-4f96c47b4de8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:25.740204 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-25a899d8-f9bb-414f-b076-4f96c47b4de8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:25.740643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-25a899d8-f9bb-414f-b076-4f96c47b4de8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:25.870983 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-25a899d8-f9bb-414f-b076-4f96c47b4de8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:25.879136 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-25a899d8-f9bb-414f-b076-4f96c47b4de8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:25.880644 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-25a899d8-f9bb-414f-b076-4f96c47b4de8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:25.881794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-25a899d8-f9bb-414f-b076-4f96c47b4de8 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.155287 Jul 21 22:39:25.882360 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 337/722] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:25 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:26.900184 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-371e608d-d5cd-4ced-9794-c795a0af3691 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:26.900792 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-371e608d-d5cd-4ced-9794-c795a0af3691 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:26.907461 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-371e608d-d5cd-4ced-9794-c795a0af3691 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:26.907913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-371e608d-d5cd-4ced-9794-c795a0af3691 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:26.908686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-371e608d-d5cd-4ced-9794-c795a0af3691 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:26.909123 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-371e608d-d5cd-4ced-9794-c795a0af3691 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:27.046274 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-371e608d-d5cd-4ced-9794-c795a0af3691 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:27.059030 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-371e608d-d5cd-4ced-9794-c795a0af3691 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:27.060637 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-371e608d-d5cd-4ced-9794-c795a0af3691 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:27.062060 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-371e608d-d5cd-4ced-9794-c795a0af3691 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.165666 Jul 21 22:39:27.062519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 386/723] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:26 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:28.081763 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-bfac9628-1d92-4697-81fa-98db398d0bfe tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:28.082373 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-bfac9628-1d92-4697-81fa-98db398d0bfe tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:28.089011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-bfac9628-1d92-4697-81fa-98db398d0bfe tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:28.089460 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-bfac9628-1d92-4697-81fa-98db398d0bfe tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:28.090238 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-bfac9628-1d92-4697-81fa-98db398d0bfe tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:28.090674 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-bfac9628-1d92-4697-81fa-98db398d0bfe tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:28.240186 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-bfac9628-1d92-4697-81fa-98db398d0bfe tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:28.249994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-bfac9628-1d92-4697-81fa-98db398d0bfe tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:28.257347 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-bfac9628-1d92-4697-81fa-98db398d0bfe tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:28.257347 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-bfac9628-1d92-4697-81fa-98db398d0bfe tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.176416 Jul 21 22:39:28.257347 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 338/724] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:28 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:28.680415 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-1fe9f3b4-6346-4f2c-9a96-be002bab57e2 req-cb0b8c93-7269-41cf-9438-d877e60ed823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec3661d-93ec-46ac-9d30-188e8863b110", "name": "network-vif-plugged", "status": "completed", "tag": "a6bccf3e-2937-4ac6-854c-3de5f045836d"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:28.690584 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-1fe9f3b4-6346-4f2c-9a96-be002bab57e2 req-cb0b8c93-7269-41cf-9438-d877e60ed823 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:28.691120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-1fe9f3b4-6346-4f2c-9a96-be002bab57e2 req-cb0b8c93-7269-41cf-9438-d877e60ed823 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:28.711691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-1fe9f3b4-6346-4f2c-9a96-be002bab57e2 req-cb0b8c93-7269-41cf-9438-d877e60ed823 service nova] Creating event network-vif-plugged:a6bccf3e-2937-4ac6-854c-3de5f045836d for instance fec3661d-93ec-46ac-9d30-188e8863b110 on hv-cinder-85069 Jul 21 22:39:28.717074 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-1fe9f3b4-6346-4f2c-9a96-be002bab57e2 req-cb0b8c93-7269-41cf-9438-d877e60ed823 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040482 Jul 21 22:39:28.717669 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 387/725] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:29.289839 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-64f356b9-a132-4846-a442-3bc0ae82181e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:29.290410 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-64f356b9-a132-4846-a442-3bc0ae82181e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:29.297418 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-64f356b9-a132-4846-a442-3bc0ae82181e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:29.297867 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-64f356b9-a132-4846-a442-3bc0ae82181e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:29.298640 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-64f356b9-a132-4846-a442-3bc0ae82181e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:29.299100 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-64f356b9-a132-4846-a442-3bc0ae82181e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:29.444741 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-64f356b9-a132-4846-a442-3bc0ae82181e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:29.453241 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-64f356b9-a132-4846-a442-3bc0ae82181e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:29.454753 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-64f356b9-a132-4846-a442-3bc0ae82181e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:29.456119 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-64f356b9-a132-4846-a442-3bc0ae82181e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.170313 Jul 21 22:39:29.456679 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 339/726] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:29 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:30.474825 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-47a13039-e018-4596-8069-346184e35b6d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:30.475549 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-47a13039-e018-4596-8069-346184e35b6d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:30.481719 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-47a13039-e018-4596-8069-346184e35b6d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:30.482166 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-47a13039-e018-4596-8069-346184e35b6d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:30.482933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-47a13039-e018-4596-8069-346184e35b6d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:30.483521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-47a13039-e018-4596-8069-346184e35b6d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:30.499873 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:30.623832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-47a13039-e018-4596-8069-346184e35b6d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:30.631824 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-47a13039-e018-4596-8069-346184e35b6d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:30.633309 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-47a13039-e018-4596-8069-346184e35b6d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:30.634449 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-47a13039-e018-4596-8069-346184e35b6d tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.163928 Jul 21 22:39:30.635008 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 388/727] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:30 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:31.654049 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-04ba1b66-206c-48d0-a0c8-f609956feec5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:31.654648 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-04ba1b66-206c-48d0-a0c8-f609956feec5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:31.662884 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-04ba1b66-206c-48d0-a0c8-f609956feec5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:31.663370 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-04ba1b66-206c-48d0-a0c8-f609956feec5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:31.664221 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-04ba1b66-206c-48d0-a0c8-f609956feec5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:31.664569 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-04ba1b66-206c-48d0-a0c8-f609956feec5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:31.811042 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-04ba1b66-206c-48d0-a0c8-f609956feec5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:31.820710 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-04ba1b66-206c-48d0-a0c8-f609956feec5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:31.822208 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-04ba1b66-206c-48d0-a0c8-f609956feec5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:31.823397 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-04ba1b66-206c-48d0-a0c8-f609956feec5 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.173913 Jul 21 22:39:31.823942 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 340/728] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:31 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:32.842123 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e1169e54-c9e1-42f0-96a4-51b2df88c274 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:32.842726 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e1169e54-c9e1-42f0-96a4-51b2df88c274 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:32.850142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e1169e54-c9e1-42f0-96a4-51b2df88c274 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:32.850591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e1169e54-c9e1-42f0-96a4-51b2df88c274 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:32.851397 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e1169e54-c9e1-42f0-96a4-51b2df88c274 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:32.852011 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e1169e54-c9e1-42f0-96a4-51b2df88c274 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:32.993814 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e1169e54-c9e1-42f0-96a4-51b2df88c274 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:33.002462 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e1169e54-c9e1-42f0-96a4-51b2df88c274 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:33.004131 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e1169e54-c9e1-42f0-96a4-51b2df88c274 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:33.005431 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e1169e54-c9e1-42f0-96a4-51b2df88c274 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1731 microversion: 2.20 time: 0.167183 Jul 21 22:39:33.006090 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 389/729] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:32 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:34.026324 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-63485523-4f2e-4848-a9fd-3606a426747c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:34.026994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-63485523-4f2e-4848-a9fd-3606a426747c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:34.029580 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:34.035583 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-63485523-4f2e-4848-a9fd-3606a426747c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:34.036027 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-63485523-4f2e-4848-a9fd-3606a426747c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:34.036781 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-63485523-4f2e-4848-a9fd-3606a426747c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:34.037207 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-63485523-4f2e-4848-a9fd-3606a426747c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:34.174644 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-63485523-4f2e-4848-a9fd-3606a426747c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:34.176894 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:34.184059 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-63485523-4f2e-4848-a9fd-3606a426747c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:34.185548 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-63485523-4f2e-4848-a9fd-3606a426747c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:34.187291 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-63485523-4f2e-4848-a9fd-3606a426747c tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1718 microversion: 2.20 time: 0.164816 Jul 21 22:39:34.187863 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 341/730] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:39:34 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:39:42.024205 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-87b5c631-de22-4065-9026-116d261773ae tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:42.024718 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-87b5c631-de22-4065-9026-116d261773ae tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:42.026665 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:42.032021 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-87b5c631-de22-4065-9026-116d261773ae tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:42.032570 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-87b5c631-de22-4065-9026-116d261773ae tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:42.033347 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-87b5c631-de22-4065-9026-116d261773ae tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:42.033838 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-87b5c631-de22-4065-9026-116d261773ae tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:42.059268 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-87b5c631-de22-4065-9026-116d261773ae tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/ips" status: 200 len: 150 microversion: 2.1 time: 0.223881 Jul 21 22:39:42.059834 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 390/731] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 22:39:41 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/ips => generated 150 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:43.409977 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6b0a48f9-9a82-45be-814e-cc90fe27abce tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3272c11f-3218-4612-abbf-42a57521b4ca"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:43.411173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-6b0a48f9-9a82-45be-814e-cc90fe27abce tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:43.419514 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b0a48f9-9a82-45be-814e-cc90fe27abce tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:43.419973 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b0a48f9-9a82-45be-814e-cc90fe27abce tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:43.420754 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b0a48f9-9a82-45be-814e-cc90fe27abce tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:43.421194 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6b0a48f9-9a82-45be-814e-cc90fe27abce tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:43.708010 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6b0a48f9-9a82-45be-814e-cc90fe27abce tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "POST /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302685 Jul 21 22:39:43.708545 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 342/732] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:39:43 2022] POST /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:39:50.280300 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-05002e5c-5fe5-44de-93b1-aee111e6ec41 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:50.280882 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-05002e5c-5fe5-44de-93b1-aee111e6ec41 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:50.287019 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-05002e5c-5fe5-44de-93b1-aee111e6ec41 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:50.287500 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-05002e5c-5fe5-44de-93b1-aee111e6ec41 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:50.288343 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-05002e5c-5fe5-44de-93b1-aee111e6ec41 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:50.288777 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-05002e5c-5fe5-44de-93b1-aee111e6ec41 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:50.377022 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-05002e5c-5fe5-44de-93b1-aee111e6ec41 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lazy-loading 'services' on Instance uuid e17eec69-e042-4b07-92e3-81b8c2710904 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:39:50.453131 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-05002e5c-5fe5-44de-93b1-aee111e6ec41 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/os-volume_attachments/3272c11f-3218-4612-abbf-42a57521b4ca" status: 202 len: 0 microversion: 2.1 time: 0.176652 Jul 21 22:39:50.453797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 391/733] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:39:50 2022] DELETE /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/os-volume_attachments/3272c11f-3218-4612-abbf-42a57521b4ca => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:39:50.463373 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2a749abe-e254-4961-ad7b-8ade490bf859 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:50.464437 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2a749abe-e254-4961-ad7b-8ade490bf859 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:50.471979 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2a749abe-e254-4961-ad7b-8ade490bf859 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:50.472442 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2a749abe-e254-4961-ad7b-8ade490bf859 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:50.473480 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2a749abe-e254-4961-ad7b-8ade490bf859 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:50.473920 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2a749abe-e254-4961-ad7b-8ade490bf859 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:50.504541 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2a749abe-e254-4961-ad7b-8ade490bf859 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045948 Jul 21 22:39:50.505361 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 343/734] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:39:50 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:51.517814 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3f25901d-ed2d-4826-92c1-7cf5a1a5c079 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:51.518963 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3f25901d-ed2d-4826-92c1-7cf5a1a5c079 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:51.525448 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3f25901d-ed2d-4826-92c1-7cf5a1a5c079 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:51.525929 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3f25901d-ed2d-4826-92c1-7cf5a1a5c079 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:51.526693 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3f25901d-ed2d-4826-92c1-7cf5a1a5c079 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:51.527158 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3f25901d-ed2d-4826-92c1-7cf5a1a5c079 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:51.556585 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3f25901d-ed2d-4826-92c1-7cf5a1a5c079 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043439 Jul 21 22:39:51.557145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 392/735] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jul 21 22:39:51 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:39:51.617091 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-768e02f5-2769-415a-b8f7-17d65dc5f504 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:51.617612 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-768e02f5-2769-415a-b8f7-17d65dc5f504 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:51.624004 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-768e02f5-2769-415a-b8f7-17d65dc5f504 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:51.624447 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-768e02f5-2769-415a-b8f7-17d65dc5f504 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:51.625206 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-768e02f5-2769-415a-b8f7-17d65dc5f504 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:51.625639 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-768e02f5-2769-415a-b8f7-17d65dc5f504 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:51.651953 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-768e02f5-2769-415a-b8f7-17d65dc5f504 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:39:51.729657 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-768e02f5-2769-415a-b8f7-17d65dc5f504 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 204 len: 0 microversion: 2.1 time: 0.116093 Jul 21 22:39:51.730252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 344/736] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:39:51 2022] DELETE /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:39:51.739484 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e8da6528-c0f1-47e3-a829-eda135ba4c9b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:51.740132 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e8da6528-c0f1-47e3-a829-eda135ba4c9b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:51.746239 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8da6528-c0f1-47e3-a829-eda135ba4c9b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:51.746617 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8da6528-c0f1-47e3-a829-eda135ba4c9b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:51.747420 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8da6528-c0f1-47e3-a829-eda135ba4c9b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:51.747861 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e8da6528-c0f1-47e3-a829-eda135ba4c9b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:51.881957 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e8da6528-c0f1-47e3-a829-eda135ba4c9b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:51.889842 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e8da6528-c0f1-47e3-a829-eda135ba4c9b tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1678 microversion: 2.1 time: 0.154719 Jul 21 22:39:51.890401 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 393/737] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:51 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:52.907723 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e0e031ba-196e-4a00-acb7-762224164772 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:52.908648 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e0e031ba-196e-4a00-acb7-762224164772 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:52.915031 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e0e031ba-196e-4a00-acb7-762224164772 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:52.915513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e0e031ba-196e-4a00-acb7-762224164772 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:52.916281 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e0e031ba-196e-4a00-acb7-762224164772 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:52.916723 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e0e031ba-196e-4a00-acb7-762224164772 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:53.046933 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-e0e031ba-196e-4a00-acb7-762224164772 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:53.054927 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e0e031ba-196e-4a00-acb7-762224164772 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1678 microversion: 2.1 time: 0.151536 Jul 21 22:39:53.055529 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 345/738] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:52 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:54.073733 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-000da2b9-4fe9-4d89-8a6f-1523ed45f5b9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:54.075297 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-000da2b9-4fe9-4d89-8a6f-1523ed45f5b9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:54.091014 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-000da2b9-4fe9-4d89-8a6f-1523ed45f5b9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:54.091771 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-000da2b9-4fe9-4d89-8a6f-1523ed45f5b9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:54.092915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-000da2b9-4fe9-4d89-8a6f-1523ed45f5b9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:54.093528 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-000da2b9-4fe9-4d89-8a6f-1523ed45f5b9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:54.167580 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-000da2b9-4fe9-4d89-8a6f-1523ed45f5b9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4284eb173fc49d1b059fdd2f3de2b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c8c5bf1b1c4caeab8b5daf28ada57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:54.177384 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-000da2b9-4fe9-4d89-8a6f-1523ed45f5b9 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 200 len: 1611 microversion: 2.1 time: 0.107325 Jul 21 22:39:54.178058 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 394/739] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:54 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 1611 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:54.276125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-2d9b5d8c-392e-4b2f-894b-a9ac6311d61a req-378f8e84-ae68-4978-a4aa-81f65728ee97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17eec69-e042-4b07-92e3-81b8c2710904", "name": "network-vif-deleted", "tag": "3fd9e5c7-12f2-4318-9993-a73043acaac8"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:54.285007 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-2d9b5d8c-392e-4b2f-894b-a9ac6311d61a req-378f8e84-ae68-4978-a4aa-81f65728ee97 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:54.285469 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-2d9b5d8c-392e-4b2f-894b-a9ac6311d61a req-378f8e84-ae68-4978-a4aa-81f65728ee97 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:54.300228 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-2d9b5d8c-392e-4b2f-894b-a9ac6311d61a req-378f8e84-ae68-4978-a4aa-81f65728ee97 service nova] Creating event network-vif-deleted:3fd9e5c7-12f2-4318-9993-a73043acaac8 for instance e17eec69-e042-4b07-92e3-81b8c2710904 on hv-cinder-85069 Jul 21 22:39:54.306729 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-2d9b5d8c-392e-4b2f-894b-a9ac6311d61a req-378f8e84-ae68-4978-a4aa-81f65728ee97 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033767 Jul 21 22:39:54.307885 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 346/740] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:55.195601 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-da23e98a-3eb4-4bec-ae52-d95904fcd820 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:55.196006 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-da23e98a-3eb4-4bec-ae52-d95904fcd820 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:55.202256 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-da23e98a-3eb4-4bec-ae52-d95904fcd820 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:55.202704 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-da23e98a-3eb4-4bec-ae52-d95904fcd820 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:55.203493 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-da23e98a-3eb4-4bec-ae52-d95904fcd820 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:55.203918 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-da23e98a-3eb4-4bec-ae52-d95904fcd820 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:55.222192 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-da23e98a-3eb4-4bec-ae52-d95904fcd820 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-da23e98a-3eb4-4bec-ae52-d95904fcd820 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 HTTP/1.1 Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:39:55.223878 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:55.225279 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'e17eec69-e042-4b07-92e3-81b8c2710904'} Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:55.226686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:55.228156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:55.229560 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-da23e98a-3eb4-4bec-ae52-d95904fcd820 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:55.229560 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-da23e98a-3eb4-4bec-ae52-d95904fcd820 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 404 len: 111 microversion: 2.1 time: 0.034407 Jul 21 22:39:55.229560 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 395/741] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:55 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:55.235157 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b546d25d-fa31-43eb-8012-322b82e27c26 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '.version_select at 0x7f47e65b1310>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:55.258803 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b546d25d-fa31-43eb-8012-322b82e27c26 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-220082898" status: 202 len: 0 microversion: 2.1 time: 0.028115 Jul 21 22:39:55.260821 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 347/742] 10.222.0.58 () {58 vars in 1217 bytes} [Thu Jul 21 22:39:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-220082898 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:39:57.109326 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9b23e56a-5a05-42fc-ad65-af71631f9716 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:57.110160 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-9b23e56a-5a05-42fc-ad65-af71631f9716 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:57.120870 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b23e56a-5a05-42fc-ad65-af71631f9716 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:57.121602 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b23e56a-5a05-42fc-ad65-af71631f9716 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:57.122881 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b23e56a-5a05-42fc-ad65-af71631f9716 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:57.123696 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9b23e56a-5a05-42fc-ad65-af71631f9716 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:57.139350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-9b23e56a-5a05-42fc-ad65-af71631f9716 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9b23e56a-5a05-42fc-ad65-af71631f9716 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: DELETE /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 HTTP/1.1 Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:39:57.141148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:57.142728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'e17eec69-e042-4b07-92e3-81b8c2710904'} Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:57.143642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:57.145257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:57.146687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9b23e56a-5a05-42fc-ad65-af71631f9716 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:57.146687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-9b23e56a-5a05-42fc-ad65-af71631f9716 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 404 len: 111 microversion: 2.1 time: 0.040114 Jul 21 22:39:57.146687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 396/743] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:39:57 2022] DELETE /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:39:57.151749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2f23e002-3bb2-41c6-960e-4d24ae63892a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:57.152467 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2f23e002-3bb2-41c6-960e-4d24ae63892a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: e17eec69-e042-4b07-92e3-81b8c2710904] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:57.160234 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2f23e002-3bb2-41c6-960e-4d24ae63892a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:57.160710 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2f23e002-3bb2-41c6-960e-4d24ae63892a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:57.161610 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2f23e002-3bb2-41c6-960e-4d24ae63892a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:57.162057 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2f23e002-3bb2-41c6-960e-4d24ae63892a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:57.178074 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-2f23e002-3bb2-41c6-960e-4d24ae63892a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2f23e002-3bb2-41c6-960e-4d24ae63892a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 HTTP/1.1 Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:39:57.179749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:57.182112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'e17eec69-e042-4b07-92e3-81b8c2710904'} Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:57.183668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. Jul 21 22:39:57.185798 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:57.187088 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2f23e002-3bb2-41c6-960e-4d24ae63892a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance e17eec69-e042-4b07-92e3-81b8c2710904 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:57.187088 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2f23e002-3bb2-41c6-960e-4d24ae63892a tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904" status: 404 len: 111 microversion: 2.1 time: 0.033395 Jul 21 22:39:57.187088 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 348/744] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:57 2022] GET /compute/v2.1/servers/e17eec69-e042-4b07-92e3-81b8c2710904 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:58.320247 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-02455152-dd21-4943-b979-e58ccc64ed47 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:58.320785 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-02455152-dd21-4943-b979-e58ccc64ed47 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:58.326712 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-02455152-dd21-4943-b979-e58ccc64ed47 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:58.327186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-02455152-dd21-4943-b979-e58ccc64ed47 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:58.327951 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-02455152-dd21-4943-b979-e58ccc64ed47 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:58.328379 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-02455152-dd21-4943-b979-e58ccc64ed47 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:58.342070 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-02455152-dd21-4943-b979-e58ccc64ed47 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-02455152-dd21-4943-b979-e58ccc64ed47 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: DELETE /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 HTTP/1.1 Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:39:58.343652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:39:58.345220 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '707386e1-842c-43e5-aee3-c9068abc8d02'} Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:58.346265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:39:58.347797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.349737 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-02455152-dd21-4943-b979-e58ccc64ed47 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:58.349737 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-02455152-dd21-4943-b979-e58ccc64ed47 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 404 len: 111 microversion: 2.1 time: 0.030043 Jul 21 22:39:58.349737 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 397/745] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:39:58 2022] DELETE /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:58.357463 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5b508ef7-7e5c-424d-9890-65d9d652eced tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:58.358366 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5b508ef7-7e5c-424d-9890-65d9d652eced tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: 707386e1-842c-43e5-aee3-c9068abc8d02] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:58.366017 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5b508ef7-7e5c-424d-9890-65d9d652eced tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:58.366427 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5b508ef7-7e5c-424d-9890-65d9d652eced tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:58.367305 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5b508ef7-7e5c-424d-9890-65d9d652eced tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:58.367751 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5b508ef7-7e5c-424d-9890-65d9d652eced tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:58.382078 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-5b508ef7-7e5c-424d-9890-65d9d652eced tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5b508ef7-7e5c-424d-9890-65d9d652eced tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 HTTP/1.1 Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:39:58.383865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:39:58.385348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': '707386e1-842c-43e5-aee3-c9068abc8d02'} Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:58.386700 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. Jul 21 22:39:58.388488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.391445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5b508ef7-7e5c-424d-9890-65d9d652eced tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance 707386e1-842c-43e5-aee3-c9068abc8d02 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:58.391445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-5b508ef7-7e5c-424d-9890-65d9d652eced tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02" status: 404 len: 111 microversion: 2.1 time: 0.034076 Jul 21 22:39:58.391445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 349/746] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:58 2022] GET /compute/v2.1/servers/707386e1-842c-43e5-aee3-c9068abc8d02 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:58.395436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ba3d325d-d9df-4fab-8e1b-b5fd077c52d1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:58.396029 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ba3d325d-d9df-4fab-8e1b-b5fd077c52d1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:58.411576 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ba3d325d-d9df-4fab-8e1b-b5fd077c52d1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:58.412051 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ba3d325d-d9df-4fab-8e1b-b5fd077c52d1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:58.413024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ba3d325d-d9df-4fab-8e1b-b5fd077c52d1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:58.413534 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ba3d325d-d9df-4fab-8e1b-b5fd077c52d1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:58.429583 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-ba3d325d-d9df-4fab-8e1b-b5fd077c52d1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ba3d325d-d9df-4fab-8e1b-b5fd077c52d1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: DELETE /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 HTTP/1.1 Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:39:58.431276 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:39:58.433067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'a1438311-05a8-4296-8299-b04c1702a3a3'} Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:58.433787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:39:58.435032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.436267 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ba3d325d-d9df-4fab-8e1b-b5fd077c52d1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:58.436267 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ba3d325d-d9df-4fab-8e1b-b5fd077c52d1 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 404 len: 111 microversion: 2.1 time: 0.042295 Jul 21 22:39:58.436267 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 398/747] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:39:58 2022] DELETE /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:58.445705 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a5f88c0c-940f-47cc-a4ca-7c4cedc468cf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:58.445705 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a5f88c0c-940f-47cc-a4ca-7c4cedc468cf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: a1438311-05a8-4296-8299-b04c1702a3a3] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:58.449478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a5f88c0c-940f-47cc-a4ca-7c4cedc468cf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:58.449478 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a5f88c0c-940f-47cc-a4ca-7c4cedc468cf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:58.450640 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a5f88c0c-940f-47cc-a4ca-7c4cedc468cf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:58.450640 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a5f88c0c-940f-47cc-a4ca-7c4cedc468cf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:58.466045 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-a5f88c0c-940f-47cc-a4ca-7c4cedc468cf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a5f88c0c-940f-47cc-a4ca-7c4cedc468cf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 HTTP/1.1 Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:39:58.467643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:39:58.469011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'a1438311-05a8-4296-8299-b04c1702a3a3'} Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:58.469808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. Jul 21 22:39:58.473551 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:58.475615 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a5f88c0c-940f-47cc-a4ca-7c4cedc468cf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance a1438311-05a8-4296-8299-b04c1702a3a3 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:58.475615 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a5f88c0c-940f-47cc-a4ca-7c4cedc468cf tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3" status: 404 len: 111 microversion: 2.1 time: 0.031271 Jul 21 22:39:58.482589 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 350/748] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:58 2022] GET /compute/v2.1/servers/a1438311-05a8-4296-8299-b04c1702a3a3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:59.622385 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-22e3caf4-31e5-4fd8-a823-76005c4e3989 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:59.622956 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-22e3caf4-31e5-4fd8-a823-76005c4e3989 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:59.629400 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-22e3caf4-31e5-4fd8-a823-76005c4e3989 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:59.629842 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-22e3caf4-31e5-4fd8-a823-76005c4e3989 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:59.630598 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-22e3caf4-31e5-4fd8-a823-76005c4e3989 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:59.631033 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-22e3caf4-31e5-4fd8-a823-76005c4e3989 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:59.645072 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-22e3caf4-31e5-4fd8-a823-76005c4e3989 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-22e3caf4-31e5-4fd8-a823-76005c4e3989 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: DELETE /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f HTTP/1.1 Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:39:59.646591 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:39:59.648142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f'} Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:59.648990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:39:59.650408 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:39:59.651860 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-22e3caf4-31e5-4fd8-a823-76005c4e3989 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:59.651860 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-22e3caf4-31e5-4fd8-a823-76005c4e3989 tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 404 len: 111 microversion: 2.1 time: 0.029488 Jul 21 22:39:59.651860 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 399/749] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:39:59 2022] DELETE /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:39:59.656435 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-aa2c6267-35bc-415e-ba48-ad11951b99cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:59.657041 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-aa2c6267-35bc-415e-ba48-ad11951b99cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] [instance: fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:59.664271 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aa2c6267-35bc-415e-ba48-ad11951b99cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:59.664716 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aa2c6267-35bc-415e-ba48-ad11951b99cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:59.665511 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aa2c6267-35bc-415e-ba48-ad11951b99cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:59.665943 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aa2c6267-35bc-415e-ba48-ad11951b99cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:59.680078 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-aa2c6267-35bc-415e-ba48-ad11951b99cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] HTTP exception thrown: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-aa2c6267-35bc-415e-ba48-ad11951b99cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Request method failure captured: Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f HTTP/1.1 Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dR0waWn61SoGWCAdkcfb6KBr_xzfTOa2_vDq7noBJRYTgvbqgA8lRUhrPl7ucAvwnQh8s0rRjjykVu3JPW2fH3xOa6xHau86hoRj1YD8EP_rmut74gOEr_HCOQnTOEwUXkjiS1IBnzo24dMmg3dMetUrIJoS7eS7dkOiGvLT__zvsI Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:39:59.681582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c8c5bf1b1c4caeab8b5daf28ada57d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c8c5bf1b1c4caeab8b5daf28ada57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: d5c8c5bf1b1c4caeab8b5daf28ada57d Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119094341 Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: c4284eb173fc49d1b059fdd2f3de2b4d Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-AttachVolumeNegativeTest-1119094341-project Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:39:59.683256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f'} Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:59.684081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. Jul 21 22:39:59.685255 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:39:59.686329 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-aa2c6267-35bc-415e-ba48-ad11951b99cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] Returning 404 to user: Instance fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:59.686329 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-aa2c6267-35bc-415e-ba48-ad11951b99cb tempest-AttachVolumeNegativeTest-1119094341 tempest-AttachVolumeNegativeTest-1119094341-project] 10.222.0.58 "GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f" status: 404 len: 111 microversion: 2.1 time: 0.030388 Jul 21 22:39:59.686329 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 351/750] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:59 2022] GET /compute/v2.1/servers/fdbad4b9-9ce2-4520-bd96-89d6ccaedd0f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:00.375431 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-131820544", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "networks": [{"uuid": "3200bd67-5f83-4ff2-9b93-8989499fec8b"}]}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:00.429520 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.network.neutron [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] validate_networks() for [('3200bd67-5f83-4ff2-9b93-8989499fec8b', None, None, None, None, None)] {{(pid=124498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:40:01.112099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Flavor limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:40:01.112935 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Image limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:40:01.113478 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Flavor pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:40:01.113952 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Image pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:40:01.114428 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:40:01.123332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:01.123775 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:01.124561 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:01.124990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:01.132186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:01.144236 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Getting quotas for project 1d10b882ad80447aa37649632a0d5692. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:40:01.148196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Getting quotas for user d84260bc6c714b7da93086841746a53a and project 1d10b882ad80447aa37649632a0d5692. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:40:01.159482 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Going to run 1 instances... {{(pid=124498) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:40:01.161723 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:40:01.207847 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f4078833-eb93-43af-98ec-647e9a83431a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836524 Jul 21 22:40:01.208846 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 400/751] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:40:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:40:01.219419 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a7b535be-a324-42f5-a4e6-5d2892c91f6a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:01.220414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a7b535be-a324-42f5-a4e6-5d2892c91f6a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:01.283739 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a7b535be-a324-42f5-a4e6-5d2892c91f6a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:01.291343 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a7b535be-a324-42f5-a4e6-5d2892c91f6a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1213 microversion: 2.1 time: 0.075980 Jul 21 22:40:01.292590 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 352/752] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:01 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:02.309762 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b7aeb8e9-2c02-47b3-a86c-40975f08d64b tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:02.310407 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b7aeb8e9-2c02-47b3-a86c-40975f08d64b tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:02.320838 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b7aeb8e9-2c02-47b3-a86c-40975f08d64b tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:02.321288 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b7aeb8e9-2c02-47b3-a86c-40975f08d64b tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:02.326870 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b7aeb8e9-2c02-47b3-a86c-40975f08d64b tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:02.327631 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b7aeb8e9-2c02-47b3-a86c-40975f08d64b tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:02.426400 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b7aeb8e9-2c02-47b3-a86c-40975f08d64b tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:02.437413 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b7aeb8e9-2c02-47b3-a86c-40975f08d64b tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1283 microversion: 2.1 time: 0.132366 Jul 21 22:40:02.438234 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 401/753] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:02 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1283 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:03.456938 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-ac0ecf81-a9bd-4179-b73d-322e832d8b0f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:03.457549 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-ac0ecf81-a9bd-4179-b73d-322e832d8b0f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:03.467959 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ac0ecf81-a9bd-4179-b73d-322e832d8b0f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:03.468818 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ac0ecf81-a9bd-4179-b73d-322e832d8b0f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:03.470344 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ac0ecf81-a9bd-4179-b73d-322e832d8b0f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:03.471039 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ac0ecf81-a9bd-4179-b73d-322e832d8b0f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:03.655308 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-ac0ecf81-a9bd-4179-b73d-322e832d8b0f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:03.668310 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-ac0ecf81-a9bd-4179-b73d-322e832d8b0f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1313 microversion: 2.1 time: 0.216321 Jul 21 22:40:03.669659 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 353/754] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:03 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:03.808364 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-612c27a1-3349-46e6-8869-b65f709bf118 req-67fa9928-6f8e-460b-8181-83a7342be826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3bd2a45-babd-4e9b-802e-eea249a791c8", "tag": "08f71ea5-ae0a-4b8a-bf6d-37297044ef45"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:03.822871 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-612c27a1-3349-46e6-8869-b65f709bf118 req-67fa9928-6f8e-460b-8181-83a7342be826 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:03.823438 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-612c27a1-3349-46e6-8869-b65f709bf118 req-67fa9928-6f8e-460b-8181-83a7342be826 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:03.838194 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-612c27a1-3349-46e6-8869-b65f709bf118 req-67fa9928-6f8e-460b-8181-83a7342be826 service nova] Creating event network-changed:08f71ea5-ae0a-4b8a-bf6d-37297044ef45 for instance d3bd2a45-babd-4e9b-802e-eea249a791c8 on hv-cinder-85069 Jul 21 22:40:03.843341 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-612c27a1-3349-46e6-8869-b65f709bf118 req-67fa9928-6f8e-460b-8181-83a7342be826 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046012 Jul 21 22:40:03.844135 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 402/755] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:04.543402 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d84a34c7-ba63-4deb-bb2d-de60d3d7cd6b tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Action: 'create', calling method: .version_select at 0x7f47e6566f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-724092353"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:04.686447 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8d7014b1-c9e6-4cf7-8569-47de110cf9d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:04.687269 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8d7014b1-c9e6-4cf7-8569-47de110cf9d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:04.694501 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8d7014b1-c9e6-4cf7-8569-47de110cf9d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:04.695230 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8d7014b1-c9e6-4cf7-8569-47de110cf9d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:04.696230 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8d7014b1-c9e6-4cf7-8569-47de110cf9d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:04.696847 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8d7014b1-c9e6-4cf7-8569-47de110cf9d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:04.856953 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8d7014b1-c9e6-4cf7-8569-47de110cf9d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:04.857517 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d84a34c7-ba63-4deb-bb2d-de60d3d7cd6b tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.436059 Jul 21 22:40:04.859411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 354/756] 10.222.0.58 () {60 vars in 1154 bytes} [Thu Jul 21 22:40:04 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 439 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 22:40:04.864803 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8d7014b1-c9e6-4cf7-8569-47de110cf9d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1313 microversion: 2.1 time: 0.182688 Jul 21 22:40:04.865657 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 403/757] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:04 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:40:04.869010 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-bd1d0368-411b-4e9a-b613-105a8475fbb6 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e65ede50>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:04.924445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-bd1d0368-411b-4e9a-b613-105a8475fbb6 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13" status: 200 len: 344 microversion: 2.1 time: 0.059536 Jul 21 22:40:04.925039 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 355/758] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:40:04 2022] GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:05.882708 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4aecefed-7ff2-410d-970c-90083f43afa9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:05.883340 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4aecefed-7ff2-410d-970c-90083f43afa9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:05.889703 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4aecefed-7ff2-410d-970c-90083f43afa9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:05.890152 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4aecefed-7ff2-410d-970c-90083f43afa9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:05.890913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4aecefed-7ff2-410d-970c-90083f43afa9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:05.891382 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4aecefed-7ff2-410d-970c-90083f43afa9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:05.937541 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e28e6458-a4d3-4db4-baf5-99fa204fbe72 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e65b11f0>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:05.986928 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e28e6458-a4d3-4db4-baf5-99fa204fbe72 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13" status: 200 len: 345 microversion: 2.1 time: 0.053272 Jul 21 22:40:05.987541 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 356/759] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:40:05 2022] GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:05.998390 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-50be36fb-1f0f-4995-9b39-4db6ed3098d3 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Action: 'create', calling method: .version_select at 0x7f47e6566a60>, body: {"snapshot": {"volume_id": "b62aa34b-843a-40e3-9caa-8693a3bf5a13", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-485626824"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:06.024411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4aecefed-7ff2-410d-970c-90083f43afa9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:06.032333 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4aecefed-7ff2-410d-970c-90083f43afa9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1313 microversion: 2.1 time: 0.153766 Jul 21 22:40:06.033042 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 404/760] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:05 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:06.155063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-50be36fb-1f0f-4995-9b39-4db6ed3098d3 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.160308 Jul 21 22:40:06.155683 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 357/761] 10.222.0.58 () {60 vars in 1161 bytes} [Thu Jul 21 22:40:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:06.168145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-47bf64f7-6ede-4ac4-886b-f7cb40de74cc tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e67a4550>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:06.200307 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-47bf64f7-6ede-4ac4-886b-f7cb40de74cc tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c" status: 200 len: 286 microversion: 2.1 time: 0.036711 Jul 21 22:40:06.200875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 405/762] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 22:40:06 2022] GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:06.210909 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-395996aa-679f-463e-8aaa-5871dfdcf074 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e6570040>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:06.246567 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-395996aa-679f-463e-8aaa-5871dfdcf074 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039148 Jul 21 22:40:06.247645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 358/763] 10.222.0.58 () {58 vars in 1139 bytes} [Thu Jul 21 22:40:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:06.261369 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e422c6d4-c1d2-4c3e-b8dc-baf9f81daa6a tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e683e700>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:06.292222 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e422c6d4-c1d2-4c3e-b8dc-baf9f81daa6a tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c" status: 200 len: 286 microversion: 2.1 time: 0.034701 Jul 21 22:40:06.292806 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 406/764] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 22:40:06 2022] GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:07.049898 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7c734935-241e-4f75-a577-3ec2666f22e4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:07.050455 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7c734935-241e-4f75-a577-3ec2666f22e4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:07.052920 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:07.059021 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c734935-241e-4f75-a577-3ec2666f22e4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:07.059606 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c734935-241e-4f75-a577-3ec2666f22e4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:07.060379 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c734935-241e-4f75-a577-3ec2666f22e4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:07.060829 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7c734935-241e-4f75-a577-3ec2666f22e4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:07.199225 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7c734935-241e-4f75-a577-3ec2666f22e4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:07.207601 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7c734935-241e-4f75-a577-3ec2666f22e4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1313 microversion: 2.1 time: 0.162215 Jul 21 22:40:07.208185 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 359/765] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:07 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:07.304690 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e9714e8e-d5c0-4430-94b4-cf043f21cdf1 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e683e310>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:07.335369 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e9714e8e-d5c0-4430-94b4-cf043f21cdf1 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c" status: 200 len: 286 microversion: 2.1 time: 0.034584 Jul 21 22:40:07.335948 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 407/766] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 22:40:07 2022] GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:08.224754 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3b54ea75-3f85-42bc-b3a8-931298894ff8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:08.225370 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3b54ea75-3f85-42bc-b3a8-931298894ff8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:08.232029 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3b54ea75-3f85-42bc-b3a8-931298894ff8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:08.232472 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3b54ea75-3f85-42bc-b3a8-931298894ff8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:08.233236 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3b54ea75-3f85-42bc-b3a8-931298894ff8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:08.233664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3b54ea75-3f85-42bc-b3a8-931298894ff8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:08.348989 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-5c975ecb-352d-417f-9273-a50f2d00d55b tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e67708b0>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:08.370264 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3b54ea75-3f85-42bc-b3a8-931298894ff8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:08.378297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3b54ea75-3f85-42bc-b3a8-931298894ff8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1313 microversion: 2.1 time: 0.158103 Jul 21 22:40:08.378872 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 360/767] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:08 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:08.381587 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-5c975ecb-352d-417f-9273-a50f2d00d55b tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c" status: 200 len: 286 microversion: 2.1 time: 0.036431 Jul 21 22:40:08.382094 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 408/768] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 22:40:08 2022] GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:09.150317 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7d92f87a-2e1c-47a0-b487-fc552397d6f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:09.151320 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7d92f87a-2e1c-47a0-b487-fc552397d6f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:09.157333 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7d92f87a-2e1c-47a0-b487-fc552397d6f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:09.158321 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7d92f87a-2e1c-47a0-b487-fc552397d6f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:09.159113 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7d92f87a-2e1c-47a0-b487-fc552397d6f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:09.159555 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7d92f87a-2e1c-47a0-b487-fc552397d6f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:09.189635 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7d92f87a-2e1c-47a0-b487-fc552397d6f0 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042643 Jul 21 22:40:09.190563 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 361/769] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:09 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:09.249798 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2c78f0d2-3680-418b-adfe-e9a1ce35293a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:09.250339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2c78f0d2-3680-418b-adfe-e9a1ce35293a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:09.257579 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2c78f0d2-3680-418b-adfe-e9a1ce35293a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:09.258040 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2c78f0d2-3680-418b-adfe-e9a1ce35293a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:09.258827 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2c78f0d2-3680-418b-adfe-e9a1ce35293a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:09.259296 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2c78f0d2-3680-418b-adfe-e9a1ce35293a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:09.287809 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2c78f0d2-3680-418b-adfe-e9a1ce35293a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Going to try to terminate instance {{(pid=124498) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:40:09.377908 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2c78f0d2-3680-418b-adfe-e9a1ce35293a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 204 len: 0 microversion: 2.20 time: 0.131370 Jul 21 22:40:09.382677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 409/770] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jul 21 22:40:09 2022] DELETE /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 22:40:09.391493 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1fc06cbd-d7dd-467a-83a7-50af686e5c1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:09.392827 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1fc06cbd-d7dd-467a-83a7-50af686e5c1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:09.399548 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1fc06cbd-d7dd-467a-83a7-50af686e5c1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:09.400278 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1fc06cbd-d7dd-467a-83a7-50af686e5c1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:09.401059 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1fc06cbd-d7dd-467a-83a7-50af686e5c1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:09.401497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1fc06cbd-d7dd-467a-83a7-50af686e5c1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:09.401927 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2e4ed55a-8907-41c4-9eb0-25a9930adef8 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e67a4e50>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:09.437739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2e4ed55a-8907-41c4-9eb0-25a9930adef8 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c" status: 200 len: 287 microversion: 2.1 time: 0.047984 Jul 21 22:40:09.438317 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 410/771] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 22:40:09 2022] GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:09.444250 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0c75b33c-41f2-4b17-803a-c4e83d4beef9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:09.444986 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0c75b33c-41f2-4b17-803a-c4e83d4beef9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:09.452193 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0c75b33c-41f2-4b17-803a-c4e83d4beef9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:09.452642 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0c75b33c-41f2-4b17-803a-c4e83d4beef9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:09.453564 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0c75b33c-41f2-4b17-803a-c4e83d4beef9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:09.454001 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0c75b33c-41f2-4b17-803a-c4e83d4beef9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:09.601041 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1fc06cbd-d7dd-467a-83a7-50af686e5c1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:09.611567 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1fc06cbd-d7dd-467a-83a7-50af686e5c1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:09.613068 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1fc06cbd-d7dd-467a-83a7-50af686e5c1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:09.614220 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1fc06cbd-d7dd-467a-83a7-50af686e5c1e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.229503 Jul 21 22:40:09.614781 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 362/772] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:40:09 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:40:09.619085 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f553b6b4-6d1e-4bf9-9008-d871cce3b996 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e6566700>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:09.632932 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-0c75b33c-41f2-4b17-803a-c4e83d4beef9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:09.641225 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0c75b33c-41f2-4b17-803a-c4e83d4beef9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1313 microversion: 2.1 time: 0.201919 Jul 21 22:40:09.641800 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 411/773] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:09 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:09.679765 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f553b6b4-6d1e-4bf9-9008-d871cce3b996 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c" status: 202 len: 0 microversion: 2.1 time: 0.063922 Jul 21 22:40:09.680342 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 363/774] 10.222.0.58 () {58 vars in 1253 bytes} [Thu Jul 21 22:40:09 2022] DELETE /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:40:09.688636 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6726dd97-7d99-4162-a4ce-965addc9749b tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e67a4820>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:09.718719 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6726dd97-7d99-4162-a4ce-965addc9749b tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c" status: 200 len: 286 microversion: 2.1 time: 0.033849 Jul 21 22:40:09.719324 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 412/775] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 22:40:09 2022] GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:10.636173 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d4f07727-7f22-4657-a7c4-12dc7352501f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:10.636779 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d4f07727-7f22-4657-a7c4-12dc7352501f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:10.643912 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d4f07727-7f22-4657-a7c4-12dc7352501f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:10.644363 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d4f07727-7f22-4657-a7c4-12dc7352501f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:10.645129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d4f07727-7f22-4657-a7c4-12dc7352501f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:10.645568 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d4f07727-7f22-4657-a7c4-12dc7352501f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:10.657997 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-48c48bac-ab08-4fa4-90b9-de6833ba620d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:10.658832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-48c48bac-ab08-4fa4-90b9-de6833ba620d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:10.665821 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48c48bac-ab08-4fa4-90b9-de6833ba620d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:10.666273 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48c48bac-ab08-4fa4-90b9-de6833ba620d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:10.667079 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48c48bac-ab08-4fa4-90b9-de6833ba620d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:10.667511 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-48c48bac-ab08-4fa4-90b9-de6833ba620d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:10.842439 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d4f07727-7f22-4657-a7c4-12dc7352501f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:10.850715 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d4f07727-7f22-4657-a7c4-12dc7352501f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:10.852289 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d4f07727-7f22-4657-a7c4-12dc7352501f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:10.853449 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d4f07727-7f22-4657-a7c4-12dc7352501f tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1724 microversion: 2.20 time: 0.221688 Jul 21 22:40:10.854379 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 364/776] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:40:10 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:40:10.855442 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-48c48bac-ab08-4fa4-90b9-de6833ba620d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:10.859555 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-92787844-e195-477d-9b45-72a2aa9f6164 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e65b13a0>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:10.863505 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-48c48bac-ab08-4fa4-90b9-de6833ba620d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1313 microversion: 2.1 time: 0.209407 Jul 21 22:40:10.867099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 413/777] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:10 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:40:10.885136 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-92787844-e195-477d-9b45-72a2aa9f6164 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] HTTP exception thrown: Snapshot a5835361-711f-427c-bd33-a3cbd344b06c could not be found. Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-92787844-e195-477d-9b45-72a2aa9f6164 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Request method failure captured: Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c HTTP/1.1 Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dXE9CXV4C9tkXjolDtwfrcvYg_rzRma9Nj975FaGD4KMaNN-3hvyvHPJqGxjYmVKbcgbW5naDCNABr6G-1Z404TmwVnp5yPM1uL-hY6agNxJLour32PYcs-AN1XzYjflrFd6O4dQVQoXYnflL6NAxK8-hP4nI-7nz17O0WnOm0EseY Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: c6be7ddcf75e41b2ac131be45afe90c1 Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:40:10.887440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6be7ddcf75e41b2ac131be45afe90c1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: c6be7ddcf75e41b2ac131be45afe90c1 Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-VolumesSnapshotsTestJSON-2136388435-project Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 009131140458431681c58cab8b662a5b Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136388435-project Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Snapshot a5835361-711f-427c-bd33-a3cbd344b06c could not be found. Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'a5835361-711f-427c-bd33-a3cbd344b06c'} Jul 21 22:40:10.889040 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a5835361-711f-427c-bd33-a3cbd344b06c could not be found. (HTTP 404) (Request-ID: req-29d9099a-7d33-40af-a955-8c25daa061a4) Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:10.890182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:40:10.891348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a5835361-711f-427c-bd33-a3cbd344b06c could not be found. Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 22:40:10.893125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a5835361-711f-427c-bd33-a3cbd344b06c could not be found. Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a5835361-711f-427c-bd33-a3cbd344b06c could not be found. Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-92787844-e195-477d-9b45-72a2aa9f6164 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Returning 404 to user: Snapshot a5835361-711f-427c-bd33-a3cbd344b06c could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:10.894338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-92787844-e195-477d-9b45-72a2aa9f6164 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c" status: 404 len: 111 microversion: 2.1 time: 0.032717 Jul 21 22:40:10.896169 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 365/778] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jul 21 22:40:10 2022] GET /compute/v2.1/os-snapshots/a5835361-711f-427c-bd33-a3cbd344b06c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:10.900731 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b515187a-8a30-4869-bedc-3fb92dbd9b26 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e6770ee0>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:10.965142 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b515187a-8a30-4869-bedc-3fb92dbd9b26 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13" status: 202 len: 0 microversion: 2.1 time: 0.067974 Jul 21 22:40:10.969036 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 414/779] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 22:40:10 2022] DELETE /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:40:10.974608 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f7484972-3c64-4e57-98b7-c14899095bcd tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e65edee0>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:11.031786 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f7484972-3c64-4e57-98b7-c14899095bcd tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13" status: 200 len: 344 microversion: 2.1 time: 0.061316 Jul 21 22:40:11.032465 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 366/780] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:40:10 2022] GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:11.133208 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-0509406a-5050-4889-a79e-eda60a1ea0b9 req-d95eedc0-43dd-4382-b6b9-0b79ff1e2018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3bd2a45-babd-4e9b-802e-eea249a791c8", "name": "network-vif-plugged", "status": "completed", "tag": "08f71ea5-ae0a-4b8a-bf6d-37297044ef45"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:11.137533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:11.144717 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-0509406a-5050-4889-a79e-eda60a1ea0b9 req-d95eedc0-43dd-4382-b6b9-0b79ff1e2018 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:11.145530 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-0509406a-5050-4889-a79e-eda60a1ea0b9 req-d95eedc0-43dd-4382-b6b9-0b79ff1e2018 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:11.156879 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=6 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:11.160380 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-0509406a-5050-4889-a79e-eda60a1ea0b9 req-d95eedc0-43dd-4382-b6b9-0b79ff1e2018 service nova] Creating event network-vif-plugged:08f71ea5-ae0a-4b8a-bf6d-37297044ef45 for instance d3bd2a45-babd-4e9b-802e-eea249a791c8 on hv-cinder-85069 Jul 21 22:40:11.166589 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-0509406a-5050-4889-a79e-eda60a1ea0b9 req-d95eedc0-43dd-4382-b6b9-0b79ff1e2018 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036590 Jul 21 22:40:11.168243 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 415/781] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:11.868378 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:11.873302 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3579710f-0acf-4ec5-bc92-e8c15bf2fe13 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:11.873905 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3579710f-0acf-4ec5-bc92-e8c15bf2fe13 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:11.881179 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-58738fdb-4a79-443c-8285-3bd95c8c9b3f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:11.881868 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-58738fdb-4a79-443c-8285-3bd95c8c9b3f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:11.883141 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3579710f-0acf-4ec5-bc92-e8c15bf2fe13 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:11.883692 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3579710f-0acf-4ec5-bc92-e8c15bf2fe13 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:11.884563 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3579710f-0acf-4ec5-bc92-e8c15bf2fe13 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:11.885097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3579710f-0acf-4ec5-bc92-e8c15bf2fe13 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:11.888322 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-58738fdb-4a79-443c-8285-3bd95c8c9b3f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:11.888765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-58738fdb-4a79-443c-8285-3bd95c8c9b3f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:11.890890 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-58738fdb-4a79-443c-8285-3bd95c8c9b3f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:11.890890 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-58738fdb-4a79-443c-8285-3bd95c8c9b3f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:11.961761 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3579710f-0acf-4ec5-bc92-e8c15bf2fe13 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:11.972531 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3579710f-0acf-4ec5-bc92-e8c15bf2fe13 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:11.974056 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3579710f-0acf-4ec5-bc92-e8c15bf2fe13 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:11.975290 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3579710f-0acf-4ec5-bc92-e8c15bf2fe13 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1657 microversion: 2.20 time: 0.107650 Jul 21 22:40:11.984794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 367/782] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:40:11 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1657 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:40:12.002418 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-4e9e31f2-c572-450b-be4a-ded175cf9edb req-9e593270-c1c7-41b3-8c8e-4dd2d30740b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec3661d-93ec-46ac-9d30-188e8863b110", "name": "network-vif-deleted", "tag": "a6bccf3e-2937-4ac6-854c-3de5f045836d"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:12.010553 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-4e9e31f2-c572-450b-be4a-ded175cf9edb req-9e593270-c1c7-41b3-8c8e-4dd2d30740b5 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:12.010992 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-4e9e31f2-c572-450b-be4a-ded175cf9edb req-9e593270-c1c7-41b3-8c8e-4dd2d30740b5 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:12.023394 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-4e9e31f2-c572-450b-be4a-ded175cf9edb req-9e593270-c1c7-41b3-8c8e-4dd2d30740b5 service nova] Creating event network-vif-deleted:a6bccf3e-2937-4ac6-854c-3de5f045836d for instance fec3661d-93ec-46ac-9d30-188e8863b110 on hv-cinder-85069 Jul 21 22:40:12.028494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-4e9e31f2-c572-450b-be4a-ded175cf9edb req-9e593270-c1c7-41b3-8c8e-4dd2d30740b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029714 Jul 21 22:40:12.029247 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 368/783] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:12.045507 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8ce34a70-5e19-46fc-946e-e942477037d1 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e65b1820>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:12.060623 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-58738fdb-4a79-443c-8285-3bd95c8c9b3f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:12.069177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-58738fdb-4a79-443c-8285-3bd95c8c9b3f tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1313 microversion: 2.1 time: 0.192647 Jul 21 22:40:12.069761 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 416/784] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:11 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:40:12.085869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-8ce34a70-5e19-46fc-946e-e942477037d1 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] HTTP exception thrown: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8ce34a70-5e19-46fc-946e-e942477037d1 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Request method failure captured: Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13 HTTP/1.1 Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dXE9CXV4C9tkXjolDtwfrcvYg_rzRma9Nj975FaGD4KMaNN-3hvyvHPJqGxjYmVKbcgbW5naDCNABr6G-1Z404TmwVnp5yPM1uL-hY6agNxJLour32PYcs-AN1XzYjflrFd6O4dQVQoXYnflL6NAxK8-hP4nI-7nz17O0WnOm0EseY Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: c6be7ddcf75e41b2ac131be45afe90c1 Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:40:12.087955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6be7ddcf75e41b2ac131be45afe90c1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: c6be7ddcf75e41b2ac131be45afe90c1 Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-VolumesSnapshotsTestJSON-2136388435-project Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 009131140458431681c58cab8b662a5b Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136388435-project Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'b62aa34b-843a-40e3-9caa-8693a3bf5a13'} Jul 21 22:40:12.089554 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. (HTTP 404) (Request-ID: req-e3f0e797-d9c7-4481-bc93-f30b1a49f324) Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:12.090515 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:40:12.093634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 22:40:12.095016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8ce34a70-5e19-46fc-946e-e942477037d1 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Returning 404 to user: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8ce34a70-5e19-46fc-946e-e942477037d1 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13" status: 404 len: 109 microversion: 2.1 time: 0.048262 Jul 21 22:40:12.096869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 369/785] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:40:12 2022] GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:12.104054 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-12930308-fab8-4a07-8152-45a78c198b62 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e68df700>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:12.135001 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-12930308-fab8-4a07-8152-45a78c198b62 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] HTTP exception thrown: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-12930308-fab8-4a07-8152-45a78c198b62 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Request method failure captured: Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: DELETE /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13 HTTP/1.1 Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dXE9CXV4C9tkXjolDtwfrcvYg_rzRma9Nj975FaGD4KMaNN-3hvyvHPJqGxjYmVKbcgbW5naDCNABr6G-1Z404TmwVnp5yPM1uL-hY6agNxJLour32PYcs-AN1XzYjflrFd6O4dQVQoXYnflL6NAxK8-hP4nI-7nz17O0WnOm0EseY Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: c6be7ddcf75e41b2ac131be45afe90c1 Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:40:12.137725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6be7ddcf75e41b2ac131be45afe90c1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: c6be7ddcf75e41b2ac131be45afe90c1 Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-VolumesSnapshotsTestJSON-2136388435-project Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: 009131140458431681c58cab8b662a5b Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136388435-project Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'b62aa34b-843a-40e3-9caa-8693a3bf5a13'} Jul 21 22:40:12.139456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. (HTTP 404) (Request-ID: req-ae3a0e8a-ffa1-4b43-beec-bd69aa30b851) Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:12.140396 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:40:12.143944 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 22:40:12.145196 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-12930308-fab8-4a07-8152-45a78c198b62 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Returning 404 to user: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-12930308-fab8-4a07-8152-45a78c198b62 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13" status: 404 len: 109 microversion: 2.1 time: 0.039178 Jul 21 22:40:12.146319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 417/786] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 22:40:12 2022] DELETE /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:12.149571 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-04497e34-bbdf-44ca-a7e3-168205c6b4f0 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Calling method '.version_select at 0x7f47e65ede50>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:12.179920 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-04497e34-bbdf-44ca-a7e3-168205c6b4f0 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] HTTP exception thrown: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-04497e34-bbdf-44ca-a7e3-168205c6b4f0 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Request method failure captured: Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13 HTTP/1.1 Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dXE9CXV4C9tkXjolDtwfrcvYg_rzRma9Nj975FaGD4KMaNN-3hvyvHPJqGxjYmVKbcgbW5naDCNABr6G-1Z404TmwVnp5yPM1uL-hY6agNxJLour32PYcs-AN1XzYjflrFd6O4dQVQoXYnflL6NAxK8-hP4nI-7nz17O0WnOm0EseY Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: c6be7ddcf75e41b2ac131be45afe90c1 Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:40:12.181857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6be7ddcf75e41b2ac131be45afe90c1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6be7ddcf75e41b2ac131be45afe90c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: c6be7ddcf75e41b2ac131be45afe90c1 Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136388435 Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-VolumesSnapshotsTestJSON-2136388435-project Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 009131140458431681c58cab8b662a5b Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136388435-project Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'b62aa34b-843a-40e3-9caa-8693a3bf5a13'} Jul 21 22:40:12.183223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. (HTTP 404) (Request-ID: req-0b9cf8bf-3620-453e-83ab-3e3146f3fc54) Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:12.184069 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:40:12.185522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 22:40:12.187756 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-04497e34-bbdf-44ca-a7e3-168205c6b4f0 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] Returning 404 to user: Volume b62aa34b-843a-40e3-9caa-8693a3bf5a13 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-04497e34-bbdf-44ca-a7e3-168205c6b4f0 tempest-VolumesSnapshotsTestJSON-2136388435 tempest-VolumesSnapshotsTestJSON-2136388435-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13" status: 404 len: 109 microversion: 2.1 time: 0.037533 Jul 21 22:40:12.190175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 370/787] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:40:12 2022] GET /compute/v2.1/os-volumes/b62aa34b-843a-40e3-9caa-8693a3bf5a13 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:12.992925 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:12.994305 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:12.998933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:13.006757 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.007290 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.008453 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.008973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.074214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.074656 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.075134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lazy-loading 'fault' on Instance uuid fec3661d-93ec-46ac-9d30-188e8863b110 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:40:13.089395 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5b921836-1f4b-4ef9-a397-d3f4e5e2ba0c tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:13.090676 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5b921836-1f4b-4ef9-a397-d3f4e5e2ba0c tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:13.114130 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5b921836-1f4b-4ef9-a397-d3f4e5e2ba0c tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.114588 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5b921836-1f4b-4ef9-a397-d3f4e5e2ba0c tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.115415 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5b921836-1f4b-4ef9-a397-d3f4e5e2ba0c tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.120791 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5b921836-1f4b-4ef9-a397-d3f4e5e2ba0c tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.144518 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:13.146816 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:13.153485 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:13.155014 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6146c8083d04171863a4b603fd6a46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9849b45b2d414797c0cb368b787ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:13.156226 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d428aaba-8b5f-4bfe-9258-496585a103e9 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 200 len: 1372 microversion: 2.20 time: 0.167551 Jul 21 22:40:13.159313 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 418/788] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:40:12 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:40:13.281133 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-5b921836-1f4b-4ef9-a397-d3f4e5e2ba0c tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:13.289191 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-5b921836-1f4b-4ef9-a397-d3f4e5e2ba0c tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1498 microversion: 2.1 time: 0.206531 Jul 21 22:40:13.289758 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 371/789] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:13 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1498 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:13.686245 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-631058e6-c681-49d3-85a6-4a8cdefce75a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:13.686743 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-631058e6-c681-49d3-85a6-4a8cdefce75a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:13.692884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-631058e6-c681-49d3-85a6-4a8cdefce75a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.693576 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-631058e6-c681-49d3-85a6-4a8cdefce75a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.694369 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-631058e6-c681-49d3-85a6-4a8cdefce75a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.694809 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-631058e6-c681-49d3-85a6-4a8cdefce75a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.725401 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-631058e6-c681-49d3-85a6-4a8cdefce75a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Going to try to terminate instance {{(pid=124498) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:40:13.803505 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-631058e6-c681-49d3-85a6-4a8cdefce75a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 204 len: 0 microversion: 2.1 time: 0.120765 Jul 21 22:40:13.804086 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 419/790] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:40:13 2022] DELETE /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:40:13.812277 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-66fcff78-6c4b-4bf8-aeff-85246d3f68ca tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:13.812886 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-66fcff78-6c4b-4bf8-aeff-85246d3f68ca tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:13.819884 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-66fcff78-6c4b-4bf8-aeff-85246d3f68ca tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.820352 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-66fcff78-6c4b-4bf8-aeff-85246d3f68ca tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.821589 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-66fcff78-6c4b-4bf8-aeff-85246d3f68ca tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.822036 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-66fcff78-6c4b-4bf8-aeff-85246d3f68ca tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.974964 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-66fcff78-6c4b-4bf8-aeff-85246d3f68ca tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:13.983623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-66fcff78-6c4b-4bf8-aeff-85246d3f68ca tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1504 microversion: 2.1 time: 0.175068 Jul 21 22:40:13.984218 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 372/791] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:13 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:14.177802 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d32a44d3-12f9-482d-b1e3-1b3575d7df0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:14.178496 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d32a44d3-12f9-482d-b1e3-1b3575d7df0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:14.184458 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d32a44d3-12f9-482d-b1e3-1b3575d7df0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:14.184900 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d32a44d3-12f9-482d-b1e3-1b3575d7df0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:14.185660 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d32a44d3-12f9-482d-b1e3-1b3575d7df0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:14.186085 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d32a44d3-12f9-482d-b1e3-1b3575d7df0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:14.200421 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-d32a44d3-12f9-482d-b1e3-1b3575d7df0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] HTTP exception thrown: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d32a44d3-12f9-482d-b1e3-1b3575d7df0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Request method failure captured: Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 HTTP/1.1 Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQg645h1Z77ccb-z5-YQvDQL3xBwIL6ReOUksvRTm2kdgEuMcAXtPOoDto6wgXDp3yhmiU44YTcXfoDjxz-Bse6bR7GQ3tuQ_GiVuYcr1YY9RQ8JrWZ_fAiVTWHuZq768ugm7x3-4DVpfNcdfHHdMv1HFzNRro4O7WCb5aau8zI1Hw Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:40:14.202342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3b9849b45b2d414797c0cb368b787ddf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: a6146c8083d04171863a4b603fd6a46c Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:14.203869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'fec3661d-93ec-46ac-9d30-188e8863b110'} Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:14.204677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:14.205875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:14.206937 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d32a44d3-12f9-482d-b1e3-1b3575d7df0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Returning 404 to user: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:14.206937 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d32a44d3-12f9-482d-b1e3-1b3575d7df0e tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 404 len: 111 microversion: 2.20 time: 0.033186 Jul 21 22:40:14.207913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 420/792] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:40:14 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:40:14.216250 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-83d2bcc2-a368-4601-9e1f-8499da77beee tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '.version_select at 0x7f47e6700310>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:14.238831 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-83d2bcc2-a368-4601-9e1f-8499da77beee tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845647875" status: 204 len: 0 microversion: 2.20 time: 0.026575 Jul 21 22:40:14.239445 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 373/793] 10.222.0.58 () {60 vars in 1261 bytes} [Thu Jul 21 22:40:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845647875 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 22:40:15.004237 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d94fbfe3-4b60-4494-8b04-6463ba995e49 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:15.004974 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d94fbfe3-4b60-4494-8b04-6463ba995e49 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:15.011586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d94fbfe3-4b60-4494-8b04-6463ba995e49 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:15.012257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d94fbfe3-4b60-4494-8b04-6463ba995e49 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:15.013301 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d94fbfe3-4b60-4494-8b04-6463ba995e49 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:15.013967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d94fbfe3-4b60-4494-8b04-6463ba995e49 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:15.162712 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d94fbfe3-4b60-4494-8b04-6463ba995e49 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:15.170685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d94fbfe3-4b60-4494-8b04-6463ba995e49 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1504 microversion: 2.1 time: 0.172626 Jul 21 22:40:15.171282 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 421/794] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:14 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:15.935869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-273b140d-4615-4c32-b005-56e50c896433 req-194dea36-5d3d-476c-bcc9-fc906eb17846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3bd2a45-babd-4e9b-802e-eea249a791c8", "name": "network-vif-deleted", "tag": "08f71ea5-ae0a-4b8a-bf6d-37297044ef45"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:16.100856 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-08cb2221-4745-4e24-814f-c691966baf6b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:16.101414 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-08cb2221-4745-4e24-814f-c691966baf6b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:16.107749 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-08cb2221-4745-4e24-814f-c691966baf6b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.108339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-08cb2221-4745-4e24-814f-c691966baf6b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.109294 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-08cb2221-4745-4e24-814f-c691966baf6b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.109978 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-08cb2221-4745-4e24-814f-c691966baf6b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.124129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-273b140d-4615-4c32-b005-56e50c896433 req-194dea36-5d3d-476c-bcc9-fc906eb17846 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.124574 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-273b140d-4615-4c32-b005-56e50c896433 req-194dea36-5d3d-476c-bcc9-fc906eb17846 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.125938 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-08cb2221-4745-4e24-814f-c691966baf6b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] HTTP exception thrown: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-08cb2221-4745-4e24-814f-c691966baf6b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Request method failure captured: Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: DELETE /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 HTTP/1.1 Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQg645h1Z77ccb-z5-YQvDQL3xBwIL6ReOUksvRTm2kdgEuMcAXtPOoDto6wgXDp3yhmiU44YTcXfoDjxz-Bse6bR7GQ3tuQ_GiVuYcr1YY9RQ8JrWZ_fAiVTWHuZq768ugm7x3-4DVpfNcdfHHdMv1HFzNRro4O7WCb5aau8zI1Hw Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:40:16.127869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3b9849b45b2d414797c0cb368b787ddf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: a6146c8083d04171863a4b603fd6a46c Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:16.129805 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'fec3661d-93ec-46ac-9d30-188e8863b110'} Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:16.130689 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:16.132145 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:16.133623 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-08cb2221-4745-4e24-814f-c691966baf6b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Returning 404 to user: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:16.133623 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-08cb2221-4745-4e24-814f-c691966baf6b tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 404 len: 111 microversion: 2.20 time: 0.035251 Jul 21 22:40:16.133623 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 422/795] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jul 21 22:40:16 2022] DELETE /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 21 22:40:16.137585 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0ed1ed50-688e-4bc7-ba72-c0a73bc16a4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:16.138173 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0ed1ed50-688e-4bc7-ba72-c0a73bc16a4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: fec3661d-93ec-46ac-9d30-188e8863b110] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:16.144370 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-273b140d-4615-4c32-b005-56e50c896433 req-194dea36-5d3d-476c-bcc9-fc906eb17846 service nova] Creating event network-vif-deleted:08f71ea5-ae0a-4b8a-bf6d-37297044ef45 for instance d3bd2a45-babd-4e9b-802e-eea249a791c8 on hv-cinder-85069 Jul 21 22:40:16.144988 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0ed1ed50-688e-4bc7-ba72-c0a73bc16a4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.145519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0ed1ed50-688e-4bc7-ba72-c0a73bc16a4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.146195 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0ed1ed50-688e-4bc7-ba72-c0a73bc16a4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.146636 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0ed1ed50-688e-4bc7-ba72-c0a73bc16a4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.150855 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-273b140d-4615-4c32-b005-56e50c896433 req-194dea36-5d3d-476c-bcc9-fc906eb17846 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219839 Jul 21 22:40:16.151645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 374/796] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:16.169201 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-0ed1ed50-688e-4bc7-ba72-c0a73bc16a4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] HTTP exception thrown: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0ed1ed50-688e-4bc7-ba72-c0a73bc16a4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Request method failure captured: Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 HTTP/1.1 Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQg645h1Z77ccb-z5-YQvDQL3xBwIL6ReOUksvRTm2kdgEuMcAXtPOoDto6wgXDp3yhmiU44YTcXfoDjxz-Bse6bR7GQ3tuQ_GiVuYcr1YY9RQ8JrWZ_fAiVTWHuZq768ugm7x3-4DVpfNcdfHHdMv1HFzNRro4O7WCb5aau8zI1Hw Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:40:16.170967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3b9849b45b2d414797c0cb368b787ddf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: a6146c8083d04171863a4b603fd6a46c Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:16.172687 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'fec3661d-93ec-46ac-9d30-188e8863b110'} Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:16.174186 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. Jul 21 22:40:16.175553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:16.176859 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0ed1ed50-688e-4bc7-ba72-c0a73bc16a4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Returning 404 to user: Instance fec3661d-93ec-46ac-9d30-188e8863b110 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:16.176859 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0ed1ed50-688e-4bc7-ba72-c0a73bc16a4a tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110" status: 404 len: 111 microversion: 2.20 time: 0.038778 Jul 21 22:40:16.176859 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 423/797] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:40:16 2022] GET /compute/v2.1/servers/fec3661d-93ec-46ac-9d30-188e8863b110 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:40:16.192084 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-60d0fed1-b76b-4aab-bcc1-1c3975e4e437 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:16.192789 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-60d0fed1-b76b-4aab-bcc1-1c3975e4e437 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:16.199994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-60d0fed1-b76b-4aab-bcc1-1c3975e4e437 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.200589 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-60d0fed1-b76b-4aab-bcc1-1c3975e4e437 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.201377 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-60d0fed1-b76b-4aab-bcc1-1c3975e4e437 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.201814 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-60d0fed1-b76b-4aab-bcc1-1c3975e4e437 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.245940 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-60d0fed1-b76b-4aab-bcc1-1c3975e4e437 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.246732 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-60d0fed1-b76b-4aab-bcc1-1c3975e4e437 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.247250 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-60d0fed1-b76b-4aab-bcc1-1c3975e4e437 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lazy-loading 'fault' on Instance uuid d3bd2a45-babd-4e9b-802e-eea249a791c8 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:40:16.318548 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-60d0fed1-b76b-4aab-bcc1-1c3975e4e437 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:16.334910 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-60d0fed1-b76b-4aab-bcc1-1c3975e4e437 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 200 len: 1303 microversion: 2.1 time: 0.148639 Jul 21 22:40:16.339098 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 375/798] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:16 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 1303 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:17.353945 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d65c0f66-d841-413b-b5aa-88ba170d31e8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:17.354555 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d65c0f66-d841-413b-b5aa-88ba170d31e8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: d3bd2a45-babd-4e9b-802e-eea249a791c8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:17.362606 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d65c0f66-d841-413b-b5aa-88ba170d31e8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:17.363118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-fd671c89-92a5-4e6e-a997-b6558287d8ce tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:17.363699 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d65c0f66-d841-413b-b5aa-88ba170d31e8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:17.363818 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-fd671c89-92a5-4e6e-a997-b6558287d8ce tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:17.364002 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d65c0f66-d841-413b-b5aa-88ba170d31e8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:17.364637 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d65c0f66-d841-413b-b5aa-88ba170d31e8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:17.370654 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fd671c89-92a5-4e6e-a997-b6558287d8ce tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:17.371125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fd671c89-92a5-4e6e-a997-b6558287d8ce tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:17.371934 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fd671c89-92a5-4e6e-a997-b6558287d8ce tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:17.372370 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fd671c89-92a5-4e6e-a997-b6558287d8ce tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:17.379171 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-d65c0f66-d841-413b-b5aa-88ba170d31e8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] HTTP exception thrown: Instance d3bd2a45-babd-4e9b-802e-eea249a791c8 could not be found. Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d65c0f66-d841-413b-b5aa-88ba170d31e8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Request method failure captured: Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 HTTP/1.1 Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dW-15YWOkSGAjk2CQECSLpq5u3YlJysXqVHMSmIY7-WxNu_tWGp9oXW1OowlTr3vqWb9Vknjs5dubuRvj9kDxYTZQ6Zcx380KCl2P9PYZFeerYdSOOgTot3lqJMGAxFjI04AaxdlyXk-qwkNL8OAoJbsS1sQom9GpBkkiOqbbRCixU Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 1d10b882ad80447aa37649632a0d5692 Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-VolumesActionsTest-1649448980 Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:40:17.380691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1d10b882ad80447aa37649632a0d5692"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1d10b882ad80447aa37649632a0d5692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1d10b882ad80447aa37649632a0d5692", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1d10b882ad80447aa37649632a0d5692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-VolumesActionsTest-1649448980 Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 1d10b882ad80447aa37649632a0d5692 Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-VolumesActionsTest-1649448980 Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-VolumesActionsTest-1649448980-project Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: d84260bc6c714b7da93086841746a53a Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-VolumesActionsTest-1649448980-project Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance d3bd2a45-babd-4e9b-802e-eea249a791c8 could not be found. Jul 21 22:40:17.382319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'd3bd2a45-babd-4e9b-802e-eea249a791c8'} Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3bd2a45-babd-4e9b-802e-eea249a791c8 could not be found. Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:17.383099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3bd2a45-babd-4e9b-802e-eea249a791c8 could not be found. Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3bd2a45-babd-4e9b-802e-eea249a791c8 could not be found. Jul 21 22:40:17.384436 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.386451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d65c0f66-d841-413b-b5aa-88ba170d31e8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Returning 404 to user: Instance d3bd2a45-babd-4e9b-802e-eea249a791c8 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:17.387041 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-fd671c89-92a5-4e6e-a997-b6558287d8ce tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] HTTP exception thrown: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:40:17.387343 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d65c0f66-d841-413b-b5aa-88ba170d31e8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8" status: 404 len: 111 microversion: 2.1 time: 0.037795 Jul 21 22:40:17.388039 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 424/799] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:17 2022] GET /compute/v2.1/servers/d3bd2a45-babd-4e9b-802e-eea249a791c8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-fd671c89-92a5-4e6e-a997-b6558287d8ce tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Request method failure captured: Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: DELETE /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 HTTP/1.1 Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dQg645h1Z77ccb-z5-YQvDQL3xBwIL6ReOUksvRTm2kdgEuMcAXtPOoDto6wgXDp3yhmiU44YTcXfoDjxz-Bse6bR7GQ3tuQ_GiVuYcr1YY9RQ8JrWZ_fAiVTWHuZq768ugm7x3-4DVpfNcdfHHdMv1HFzNRro4O7WCb5aau8zI1Hw Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:40:17.391994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3b9849b45b2d414797c0cb368b787ddf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: a6146c8083d04171863a4b603fd6a46c Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:40:17.393618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'bdafcf28-8b2d-4692-ba35-cd63d2c32de7'} Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:17.394412 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:40:17.395664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.396897 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-fd671c89-92a5-4e6e-a997-b6558287d8ce tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Returning 404 to user: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:17.396897 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-fd671c89-92a5-4e6e-a997-b6558287d8ce tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 404 len: 111 microversion: 2.20 time: 0.036036 Jul 21 22:40:17.396897 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 376/800] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jul 21 22:40:17 2022] DELETE /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:40:17.406651 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e95ae5b4-c998-4535-8920-c2a2066d7242 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:17.407848 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e95ae5b4-c998-4535-8920-c2a2066d7242 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] [instance: bdafcf28-8b2d-4692-ba35-cd63d2c32de7] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:17.423630 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e95ae5b4-c998-4535-8920-c2a2066d7242 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:17.424125 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e95ae5b4-c998-4535-8920-c2a2066d7242 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:17.425096 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e95ae5b4-c998-4535-8920-c2a2066d7242 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:17.425581 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e95ae5b4-c998-4535-8920-c2a2066d7242 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:17.445033 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-e95ae5b4-c998-4535-8920-c2a2066d7242 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] HTTP exception thrown: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e95ae5b4-c998-4535-8920-c2a2066d7242 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Request method failure captured: Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 HTTP/1.1 Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dQg645h1Z77ccb-z5-YQvDQL3xBwIL6ReOUksvRTm2kdgEuMcAXtPOoDto6wgXDp3yhmiU44YTcXfoDjxz-Bse6bR7GQ3tuQ_GiVuYcr1YY9RQ8JrWZ_fAiVTWHuZq768ugm7x3-4DVpfNcdfHHdMv1HFzNRro4O7WCb5aau8zI1Hw Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:40:17.446604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3b9849b45b2d414797c0cb368b787ddf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3b9849b45b2d414797c0cb368b787ddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 3b9849b45b2d414797c0cb368b787ddf Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-829209392 Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: a6146c8083d04171863a4b603fd6a46c Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-829209392-project Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:40:17.451144 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'bdafcf28-8b2d-4692-ba35-cd63d2c32de7'} Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:17.452155 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. Jul 21 22:40:17.454680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:17.457631 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e95ae5b4-c998-4535-8920-c2a2066d7242 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] Returning 404 to user: Instance bdafcf28-8b2d-4692-ba35-cd63d2c32de7 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:17.457631 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e95ae5b4-c998-4535-8920-c2a2066d7242 tempest-AttachVolumeShelveTestJSON-829209392 tempest-AttachVolumeShelveTestJSON-829209392-project] 10.222.0.58 "GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7" status: 404 len: 111 microversion: 2.20 time: 0.045354 Jul 21 22:40:17.457631 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 425/801] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jul 21 22:40:17 2022] GET /compute/v2.1/servers/bdafcf28-8b2d-4692-ba35-cd63d2c32de7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:40:17.518528 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1845216151", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "networks": [{"uuid": "3200bd67-5f83-4ff2-9b93-8989499fec8b"}]}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:17.579353 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] validate_networks() for [('3200bd67-5f83-4ff2-9b93-8989499fec8b', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:40:18.081464 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:40:18.082063 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:40:18.082668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:40:18.083089 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:40:18.083509 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:40:18.093327 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:18.093695 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:18.094502 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:18.095130 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:18.114992 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Getting quotas for project 1d10b882ad80447aa37649632a0d5692. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:40:18.119549 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Getting quotas for user d84260bc6c714b7da93086841746a53a and project 1d10b882ad80447aa37649632a0d5692. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:40:18.132104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:40:18.134400 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:40:18.202663 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e446df90-41a6-4d17-847a-f2b90ab24de9 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689042 Jul 21 22:40:18.210289 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 377/802] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:40:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:40:18.214869 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e9a6e5f1-b081-43d9-8169-f4158a07a88a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:18.215347 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e9a6e5f1-b081-43d9-8169-f4158a07a88a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:18.289614 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e9a6e5f1-b081-43d9-8169-f4158a07a88a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:18.296789 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e9a6e5f1-b081-43d9-8169-f4158a07a88a tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1214 microversion: 2.1 time: 0.085943 Jul 21 22:40:18.299251 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 426/803] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:18 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:19.315166 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-69104ba1-4ee7-4a3d-9137-0ed04ef79253 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:19.316143 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-69104ba1-4ee7-4a3d-9137-0ed04ef79253 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:19.326104 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-69104ba1-4ee7-4a3d-9137-0ed04ef79253 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:19.326664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-69104ba1-4ee7-4a3d-9137-0ed04ef79253 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:19.327757 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-69104ba1-4ee7-4a3d-9137-0ed04ef79253 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:19.328272 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-69104ba1-4ee7-4a3d-9137-0ed04ef79253 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:19.413646 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-69104ba1-4ee7-4a3d-9137-0ed04ef79253 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:19.423731 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-69104ba1-4ee7-4a3d-9137-0ed04ef79253 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1284 microversion: 2.1 time: 0.113219 Jul 21 22:40:19.425211 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 378/804] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:19 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:20.442432 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b16d8fca-6455-4bd5-8944-7e7e27d8ee01 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:20.443150 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b16d8fca-6455-4bd5-8944-7e7e27d8ee01 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:20.458119 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b16d8fca-6455-4bd5-8944-7e7e27d8ee01 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:20.459879 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b16d8fca-6455-4bd5-8944-7e7e27d8ee01 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:20.462453 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b16d8fca-6455-4bd5-8944-7e7e27d8ee01 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:20.464361 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b16d8fca-6455-4bd5-8944-7e7e27d8ee01 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:20.493889 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:20.781609 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b16d8fca-6455-4bd5-8944-7e7e27d8ee01 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:20.792862 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b16d8fca-6455-4bd5-8944-7e7e27d8ee01 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1314 microversion: 2.1 time: 0.355141 Jul 21 22:40:20.804543 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 427/805] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:20 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:21.205659 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-29de9608-92d5-4ac0-9cce-f42fcb25e44e req-d8c1f48c-3c4a-4cb3-93d0-fb2875562540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7043f7f3-a71f-42d7-9348-ce71f5de0e5e", "tag": "17f1e569-70f8-49e8-afa0-db460e752a5a"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:21.242766 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-29de9608-92d5-4ac0-9cce-f42fcb25e44e req-d8c1f48c-3c4a-4cb3-93d0-fb2875562540 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:21.243779 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-29de9608-92d5-4ac0-9cce-f42fcb25e44e req-d8c1f48c-3c4a-4cb3-93d0-fb2875562540 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:21.260647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-29de9608-92d5-4ac0-9cce-f42fcb25e44e req-d8c1f48c-3c4a-4cb3-93d0-fb2875562540 service nova] Creating event network-changed:17f1e569-70f8-49e8-afa0-db460e752a5a for instance 7043f7f3-a71f-42d7-9348-ce71f5de0e5e on hv-cinder-85069 Jul 21 22:40:21.266780 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-29de9608-92d5-4ac0-9cce-f42fcb25e44e req-d8c1f48c-3c4a-4cb3-93d0-fb2875562540 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067687 Jul 21 22:40:21.268539 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 379/806] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:21.812338 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c372f0ae-51f4-4190-981d-d145f313a024 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:21.814184 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c372f0ae-51f4-4190-981d-d145f313a024 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:21.827890 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c372f0ae-51f4-4190-981d-d145f313a024 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:21.828593 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c372f0ae-51f4-4190-981d-d145f313a024 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:21.830297 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c372f0ae-51f4-4190-981d-d145f313a024 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:21.830297 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c372f0ae-51f4-4190-981d-d145f313a024 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:22.087956 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c372f0ae-51f4-4190-981d-d145f313a024 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:22.096974 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c372f0ae-51f4-4190-981d-d145f313a024 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1314 microversion: 2.1 time: 0.288459 Jul 21 22:40:22.097614 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 428/807] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:21 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:23.115189 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f9d38374-a415-4854-a14a-36c0b02933a4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:23.116087 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f9d38374-a415-4854-a14a-36c0b02933a4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:23.125645 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f9d38374-a415-4854-a14a-36c0b02933a4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:23.126227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f9d38374-a415-4854-a14a-36c0b02933a4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:23.127023 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f9d38374-a415-4854-a14a-36c0b02933a4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:23.127583 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f9d38374-a415-4854-a14a-36c0b02933a4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:23.267486 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f9d38374-a415-4854-a14a-36c0b02933a4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:23.274979 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f9d38374-a415-4854-a14a-36c0b02933a4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1314 microversion: 2.1 time: 0.164476 Jul 21 22:40:23.275583 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 380/808] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:23 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:23.377726 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9d19cd52-4eba-4b0e-9d0e-6696b82c278d tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] Action: 'create', calling method: .version_select at 0x7f47e6770f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-991682943", "metadata": {"Type": "work"}}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:23.674999 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-9d19cd52-4eba-4b0e-9d0e-6696b82c278d tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.416588 Jul 21 22:40:23.675772 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 429/809] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jul 21 22:40:23 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 418 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 21 22:40:23.686513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-bb1abefc-424d-414b-8bb1-b98b6929c299 tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] Calling method '.version_select at 0x7f47e65ad940>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:23.735697 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-bb1abefc-424d-414b-8bb1-b98b6929c299 tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3" status: 200 len: 352 microversion: 2.1 time: 0.052743 Jul 21 22:40:23.736373 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 381/810] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:40:23 2022] GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:24.292328 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d9590b66-3be5-44c9-84d4-e6dc49da8fbb tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:24.292850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d9590b66-3be5-44c9-84d4-e6dc49da8fbb tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:24.299156 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d9590b66-3be5-44c9-84d4-e6dc49da8fbb tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:24.299609 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d9590b66-3be5-44c9-84d4-e6dc49da8fbb tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:24.300386 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d9590b66-3be5-44c9-84d4-e6dc49da8fbb tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:24.300823 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d9590b66-3be5-44c9-84d4-e6dc49da8fbb tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:24.442404 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d9590b66-3be5-44c9-84d4-e6dc49da8fbb tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:24.449960 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d9590b66-3be5-44c9-84d4-e6dc49da8fbb tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1314 microversion: 2.1 time: 0.161698 Jul 21 22:40:24.450533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 430/811] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:24 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:24.748304 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-521f6d63-f4c1-46b4-bc4a-0f879cc6bd9a tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] Calling method '.version_select at 0x7f47e65ed280>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:24.804311 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-521f6d63-f4c1-46b4-bc4a-0f879cc6bd9a tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3" status: 200 len: 352 microversion: 2.1 time: 0.060410 Jul 21 22:40:24.804892 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 382/812] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:40:24 2022] GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:25.467607 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-07e368c6-9ec0-455b-abcd-5a7ad465ef8e tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:25.468206 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-07e368c6-9ec0-455b-abcd-5a7ad465ef8e tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:25.475434 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07e368c6-9ec0-455b-abcd-5a7ad465ef8e tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:25.475933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07e368c6-9ec0-455b-abcd-5a7ad465ef8e tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:25.476833 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07e368c6-9ec0-455b-abcd-5a7ad465ef8e tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:25.477446 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-07e368c6-9ec0-455b-abcd-5a7ad465ef8e tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:25.609786 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-07e368c6-9ec0-455b-abcd-5a7ad465ef8e tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:25.617691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-07e368c6-9ec0-455b-abcd-5a7ad465ef8e tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1314 microversion: 2.1 time: 0.154047 Jul 21 22:40:25.618260 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 431/813] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:25 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:25.819480 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-87abaec1-6635-4b99-af1c-d3f6cbd45579 tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] Calling method '.version_select at 0x7f47e65b19d0>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:25.868147 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-87abaec1-6635-4b99-af1c-d3f6cbd45579 tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3" status: 200 len: 353 microversion: 2.1 time: 0.055177 Jul 21 22:40:25.868747 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 383/814] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:40:25 2022] GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:25.880352 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b5d41531-3e29-46e5-a702-704daca44f12 tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] Calling method '.version_select at 0x7f47e68dfa60>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:25.932956 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b5d41531-3e29-46e5-a702-704daca44f12 tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3" status: 200 len: 353 microversion: 2.1 time: 0.057115 Jul 21 22:40:25.933611 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 432/815] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:40:25 2022] GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:25.952231 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9c044f7a-a859-4a73-807e-e54a7a528812 tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] Calling method '.version_select at 0x7f47e65ed0d0>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:26.015808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-9c044f7a-a859-4a73-807e-e54a7a528812 tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3" status: 202 len: 0 microversion: 2.1 time: 0.067554 Jul 21 22:40:26.016938 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 384/816] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jul 21 22:40:25 2022] DELETE /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:40:26.025022 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3297fd08-c601-4e84-ac12-64f0117a2e3f tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] Calling method '.version_select at 0x7f47e683e4c0>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:26.076369 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3297fd08-c601-4e84-ac12-64f0117a2e3f tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3" status: 200 len: 352 microversion: 2.1 time: 0.055179 Jul 21 22:40:26.077521 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 433/817] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:40:26 2022] GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:26.636054 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6ff8a9fc-1990-4ff1-bdf5-88b95b7b7d7d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:26.636672 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-6ff8a9fc-1990-4ff1-bdf5-88b95b7b7d7d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:26.644045 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6ff8a9fc-1990-4ff1-bdf5-88b95b7b7d7d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:26.644501 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6ff8a9fc-1990-4ff1-bdf5-88b95b7b7d7d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:26.645274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6ff8a9fc-1990-4ff1-bdf5-88b95b7b7d7d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:26.645719 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6ff8a9fc-1990-4ff1-bdf5-88b95b7b7d7d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:26.780801 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6ff8a9fc-1990-4ff1-bdf5-88b95b7b7d7d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:26.788718 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6ff8a9fc-1990-4ff1-bdf5-88b95b7b7d7d tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1314 microversion: 2.1 time: 0.156774 Jul 21 22:40:26.789301 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 385/818] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:26 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:27.089490 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-baf1f039-66ea-4a4b-849a-0f3d705a80ec tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] Calling method '.version_select at 0x7f47e67704c0>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:27.119228 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-baf1f039-66ea-4a4b-849a-0f3d705a80ec tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] HTTP exception thrown: Volume a04d437a-daaf-48ea-b861-7113038e13b3 could not be found. Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-baf1f039-66ea-4a4b-849a-0f3d705a80ec tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] Request method failure captured: Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3 HTTP/1.1 Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dXX2HC1WiD9L9L1uSNqAs91lRUrZzaL9gcPe-OGI2ISc2ykuUIGHSc1N-UMTii5gpJzv1pMWG1fV3dw3iDPiy4iVDk1ncDGpDpsC4vuq-thlBUnDK2RPm9xvduRSezRbt5LPR8ELFoMcGz3AvBm4bvCD1mRYLZy9vWmaKsYiNOnf8E Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 68bd5ea42b6f40b89decb32180fae98c Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-VolumesGetTestJSON-2147248000 Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:40:27.121157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68bd5ea42b6f40b89decb32180fae98c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68bd5ea42b6f40b89decb32180fae98c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_68bd5ea42b6f40b89decb32180fae98c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/68bd5ea42b6f40b89decb32180fae98c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-VolumesGetTestJSON-2147248000 Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 68bd5ea42b6f40b89decb32180fae98c Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-VolumesGetTestJSON-2147248000 Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-VolumesGetTestJSON-2147248000-project Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: 4f37aec0e2b64f64a6eb524e39f49b49 Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-VolumesGetTestJSON-2147248000-project Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Volume a04d437a-daaf-48ea-b861-7113038e13b3 could not be found. Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'a04d437a-daaf-48ea-b861-7113038e13b3'} Jul 21 22:40:27.122885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a04d437a-daaf-48ea-b861-7113038e13b3 could not be found. (HTTP 404) (Request-ID: req-a52aad2a-83e9-4df0-892c-72242a3cd1e8) Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:27.123966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:40:27.125466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a04d437a-daaf-48ea-b861-7113038e13b3 could not be found. Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 22:40:27.127024 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a04d437a-daaf-48ea-b861-7113038e13b3 could not be found. Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a04d437a-daaf-48ea-b861-7113038e13b3 could not be found. Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-baf1f039-66ea-4a4b-849a-0f3d705a80ec tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] Returning 404 to user: Volume a04d437a-daaf-48ea-b861-7113038e13b3 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-baf1f039-66ea-4a4b-849a-0f3d705a80ec tempest-VolumesGetTestJSON-2147248000 tempest-VolumesGetTestJSON-2147248000-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3" status: 404 len: 109 microversion: 2.1 time: 0.037075 Jul 21 22:40:27.128492 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 434/819] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jul 21 22:40:27 2022] GET /compute/v2.1/os-volumes/a04d437a-daaf-48ea-b861-7113038e13b3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:27.428082 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-5acd281b-ae61-4315-8681-a811cc8ab388 req-7bd92295-1ea5-4a4d-8702-117fbaf14fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7043f7f3-a71f-42d7-9348-ce71f5de0e5e", "name": "network-vif-plugged", "status": "completed", "tag": "17f1e569-70f8-49e8-afa0-db460e752a5a"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:27.440688 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-5acd281b-ae61-4315-8681-a811cc8ab388 req-7bd92295-1ea5-4a4d-8702-117fbaf14fb7 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:27.441595 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-5acd281b-ae61-4315-8681-a811cc8ab388 req-7bd92295-1ea5-4a4d-8702-117fbaf14fb7 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:27.454546 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-5acd281b-ae61-4315-8681-a811cc8ab388 req-7bd92295-1ea5-4a4d-8702-117fbaf14fb7 service nova] Creating event network-vif-plugged:17f1e569-70f8-49e8-afa0-db460e752a5a for instance 7043f7f3-a71f-42d7-9348-ce71f5de0e5e on hv-cinder-85069 Jul 21 22:40:27.459922 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-5acd281b-ae61-4315-8681-a811cc8ab388 req-7bd92295-1ea5-4a4d-8702-117fbaf14fb7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035925 Jul 21 22:40:27.460765 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 386/820] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:27.807694 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e219185f-516a-4060-a169-9771f0b525be tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:27.808565 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e219185f-516a-4060-a169-9771f0b525be tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:27.819666 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e219185f-516a-4060-a169-9771f0b525be tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:27.820181 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e219185f-516a-4060-a169-9771f0b525be tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:27.820959 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e219185f-516a-4060-a169-9771f0b525be tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:27.821344 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e219185f-516a-4060-a169-9771f0b525be tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:27.960487 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e219185f-516a-4060-a169-9771f0b525be tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:27.968399 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e219185f-516a-4060-a169-9771f0b525be tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1314 microversion: 2.1 time: 0.166553 Jul 21 22:40:27.969067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 435/821] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:27 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:28.983106 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:28.983847 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=6 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:28.989127 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b4a0e3d6-eca2-4f47-8943-967870795c58 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:28.989824 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b4a0e3d6-eca2-4f47-8943-967870795c58 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:28.999571 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b4a0e3d6-eca2-4f47-8943-967870795c58 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:29.000021 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b4a0e3d6-eca2-4f47-8943-967870795c58 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:29.000896 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b4a0e3d6-eca2-4f47-8943-967870795c58 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:29.001265 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b4a0e3d6-eca2-4f47-8943-967870795c58 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:29.140325 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b4a0e3d6-eca2-4f47-8943-967870795c58 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:29.148381 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b4a0e3d6-eca2-4f47-8943-967870795c58 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1314 microversion: 2.1 time: 0.166323 Jul 21 22:40:29.148951 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 387/822] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:28 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:30.166120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1cf558de-01ab-4918-9171-8f1687eaec85 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:30.166794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1cf558de-01ab-4918-9171-8f1687eaec85 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:30.168794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:30.175709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1cf558de-01ab-4918-9171-8f1687eaec85 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.176092 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1cf558de-01ab-4918-9171-8f1687eaec85 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:30.176866 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1cf558de-01ab-4918-9171-8f1687eaec85 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.177303 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-1cf558de-01ab-4918-9171-8f1687eaec85 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:30.314120 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1cf558de-01ab-4918-9171-8f1687eaec85 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:30.324914 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1cf558de-01ab-4918-9171-8f1687eaec85 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1498 microversion: 2.1 time: 0.162914 Jul 21 22:40:30.325483 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 436/823] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:30 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:30.785033 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f2372022-21d6-4a20-9124-9a02962feb31 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:30.785562 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f2372022-21d6-4a20-9124-9a02962feb31 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:30.792073 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f2372022-21d6-4a20-9124-9a02962feb31 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.792517 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f2372022-21d6-4a20-9124-9a02962feb31 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:30.793270 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f2372022-21d6-4a20-9124-9a02962feb31 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.793697 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f2372022-21d6-4a20-9124-9a02962feb31 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:30.819383 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f2372022-21d6-4a20-9124-9a02962feb31 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:40:30.894258 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f2372022-21d6-4a20-9124-9a02962feb31 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 204 len: 0 microversion: 2.1 time: 0.112689 Jul 21 22:40:30.894902 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 388/824] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:40:30 2022] DELETE /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:40:30.903506 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-302c53b2-fd94-4b56-a47c-b46da9ade3d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:30.904148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-302c53b2-fd94-4b56-a47c-b46da9ade3d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:30.910736 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-302c53b2-fd94-4b56-a47c-b46da9ade3d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.911219 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-302c53b2-fd94-4b56-a47c-b46da9ade3d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:30.911987 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-302c53b2-fd94-4b56-a47c-b46da9ade3d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.912422 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-302c53b2-fd94-4b56-a47c-b46da9ade3d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:31.043449 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-302c53b2-fd94-4b56-a47c-b46da9ade3d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:31.051625 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-302c53b2-fd94-4b56-a47c-b46da9ade3d8 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1504 microversion: 2.1 time: 0.152152 Jul 21 22:40:31.052191 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 437/825] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:30 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:32.071267 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-456e88cf-5637-4b3b-b085-20d0cec8b540 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:32.072066 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-456e88cf-5637-4b3b-b085-20d0cec8b540 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:32.078632 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-456e88cf-5637-4b3b-b085-20d0cec8b540 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:32.079186 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-456e88cf-5637-4b3b-b085-20d0cec8b540 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:32.079887 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-456e88cf-5637-4b3b-b085-20d0cec8b540 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:32.080331 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-456e88cf-5637-4b3b-b085-20d0cec8b540 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:32.226091 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-456e88cf-5637-4b3b-b085-20d0cec8b540 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:32.233987 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-456e88cf-5637-4b3b-b085-20d0cec8b540 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1504 microversion: 2.1 time: 0.166993 Jul 21 22:40:32.234575 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 389/826] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:32 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:33.251898 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6c5435e8-8364-4fe9-bd95-0de4e4268a24 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:33.252627 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6c5435e8-8364-4fe9-bd95-0de4e4268a24 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:33.258874 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c5435e8-8364-4fe9-bd95-0de4e4268a24 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:33.259361 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c5435e8-8364-4fe9-bd95-0de4e4268a24 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:33.260140 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c5435e8-8364-4fe9-bd95-0de4e4268a24 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:33.260581 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c5435e8-8364-4fe9-bd95-0de4e4268a24 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:33.397512 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6c5435e8-8364-4fe9-bd95-0de4e4268a24 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:33.405067 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6c5435e8-8364-4fe9-bd95-0de4e4268a24 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1504 microversion: 2.1 time: 0.158103 Jul 21 22:40:33.405637 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 438/827] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:33 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:34.422847 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-06eec62d-0269-42c9-bf1b-66bb098f00d4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:34.423548 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-06eec62d-0269-42c9-bf1b-66bb098f00d4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:34.430232 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06eec62d-0269-42c9-bf1b-66bb098f00d4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:34.430691 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06eec62d-0269-42c9-bf1b-66bb098f00d4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:34.431508 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06eec62d-0269-42c9-bf1b-66bb098f00d4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:34.431951 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-06eec62d-0269-42c9-bf1b-66bb098f00d4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:34.435440 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-10dbf22a-fc3f-4b1e-b0dc-b65b13cc3ea7 req-b985fee5-8608-4747-b418-0be8f75e9e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7043f7f3-a71f-42d7-9348-ce71f5de0e5e", "name": "network-vif-deleted", "tag": "17f1e569-70f8-49e8-afa0-db460e752a5a"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:34.444933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-10dbf22a-fc3f-4b1e-b0dc-b65b13cc3ea7 req-b985fee5-8608-4747-b418-0be8f75e9e2f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:34.445745 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-10dbf22a-fc3f-4b1e-b0dc-b65b13cc3ea7 req-b985fee5-8608-4747-b418-0be8f75e9e2f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:34.460674 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-10dbf22a-fc3f-4b1e-b0dc-b65b13cc3ea7 req-b985fee5-8608-4747-b418-0be8f75e9e2f service nova] Creating event network-vif-deleted:17f1e569-70f8-49e8-afa0-db460e752a5a for instance 7043f7f3-a71f-42d7-9348-ce71f5de0e5e on hv-cinder-85069 Jul 21 22:40:34.466830 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-10dbf22a-fc3f-4b1e-b0dc-b65b13cc3ea7 req-b985fee5-8608-4747-b418-0be8f75e9e2f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034921 Jul 21 22:40:34.468164 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 439/828] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:34.506582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-06eec62d-0269-42c9-bf1b-66bb098f00d4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84260bc6c714b7da93086841746a53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d10b882ad80447aa37649632a0d5692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:34.514423 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-06eec62d-0269-42c9-bf1b-66bb098f00d4 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 200 len: 1462 microversion: 2.1 time: 0.095743 Jul 21 22:40:34.514987 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 390/829] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:34 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:35.537416 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-bddf5dc8-4f37-488f-bc7c-2e13397aee65 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:35.538033 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-bddf5dc8-4f37-488f-bc7c-2e13397aee65 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] [instance: 7043f7f3-a71f-42d7-9348-ce71f5de0e5e] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:35.544443 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bddf5dc8-4f37-488f-bc7c-2e13397aee65 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:35.544900 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bddf5dc8-4f37-488f-bc7c-2e13397aee65 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:35.545670 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bddf5dc8-4f37-488f-bc7c-2e13397aee65 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:35.546101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-bddf5dc8-4f37-488f-bc7c-2e13397aee65 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:35.560107 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-bddf5dc8-4f37-488f-bc7c-2e13397aee65 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] HTTP exception thrown: Instance 7043f7f3-a71f-42d7-9348-ce71f5de0e5e could not be found. Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-bddf5dc8-4f37-488f-bc7c-2e13397aee65 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Request method failure captured: Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e HTTP/1.1 Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dW-15YWOkSGAjk2CQECSLpq5u3YlJysXqVHMSmIY7-WxNu_tWGp9oXW1OowlTr3vqWb9Vknjs5dubuRvj9kDxYTZQ6Zcx380KCl2P9PYZFeerYdSOOgTot3lqJMGAxFjI04AaxdlyXk-qwkNL8OAoJbsS1sQom9GpBkkiOqbbRCixU Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 1d10b882ad80447aa37649632a0d5692 Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-VolumesActionsTest-1649448980 Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:40:35.561735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1d10b882ad80447aa37649632a0d5692"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1d10b882ad80447aa37649632a0d5692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1d10b882ad80447aa37649632a0d5692", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1d10b882ad80447aa37649632a0d5692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-VolumesActionsTest-1649448980 Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 1d10b882ad80447aa37649632a0d5692 Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-VolumesActionsTest-1649448980 Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-VolumesActionsTest-1649448980-project Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: d84260bc6c714b7da93086841746a53a Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-VolumesActionsTest-1649448980-project Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 7043f7f3-a71f-42d7-9348-ce71f5de0e5e could not be found. Jul 21 22:40:35.563325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '7043f7f3-a71f-42d7-9348-ce71f5de0e5e'} Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7043f7f3-a71f-42d7-9348-ce71f5de0e5e could not be found. Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:40:35.564283 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7043f7f3-a71f-42d7-9348-ce71f5de0e5e could not be found. Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7043f7f3-a71f-42d7-9348-ce71f5de0e5e could not be found. Jul 21 22:40:35.566314 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:40:35.567500 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-bddf5dc8-4f37-488f-bc7c-2e13397aee65 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] Returning 404 to user: Instance 7043f7f3-a71f-42d7-9348-ce71f5de0e5e could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:40:35.567500 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-bddf5dc8-4f37-488f-bc7c-2e13397aee65 tempest-VolumesActionsTest-1649448980 tempest-VolumesActionsTest-1649448980-project] 10.222.0.58 "GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e" status: 404 len: 111 microversion: 2.1 time: 0.032482 Jul 21 22:40:35.567500 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 440/830] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:35 2022] GET /compute/v2.1/servers/7043f7f3-a71f-42d7-9348-ce71f5de0e5e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:41:05.626485 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2115639561", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:05.640900 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:05.641620 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:05.697533 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] validate_networks() for None {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:41:05.988327 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:41:05.988751 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:41:05.989218 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:41:05.989623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:41:05.990030 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:41:06.003177 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:06.003631 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:06.004635 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:06.005087 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:06.022345 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Getting quotas for project 4d1af09e3e2b40be92caf9c0ef51b099. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:41:06.026993 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Getting quotas for user 00304ab3aada47ccb0756d40b5484ea3 and project 4d1af09e3e2b40be92caf9c0ef51b099. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:41:06.039206 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:41:06.041460 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:41:06.086954 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b6dcee55-5f6b-4396-81bf-d433e98fb0d2 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.464306 Jul 21 22:41:06.091217 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 391/831] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:41:06.098405 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7427caa8-c06a-46aa-b76d-7838268b29d6 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:06.099017 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7427caa8-c06a-46aa-b76d-7838268b29d6 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:06.117169 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:06.118341 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=49 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:06.178845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7427caa8-c06a-46aa-b76d-7838268b29d6 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:06.187281 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7427caa8-c06a-46aa-b76d-7838268b29d6 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1215 microversion: 2.1 time: 0.092527 Jul 21 22:41:06.187871 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 441/832] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:06 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:07.205162 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b202a4bf-40bc-4e10-8c59-26e7983b1006 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:07.206189 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b202a4bf-40bc-4e10-8c59-26e7983b1006 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:07.213128 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b202a4bf-40bc-4e10-8c59-26e7983b1006 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:07.213572 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b202a4bf-40bc-4e10-8c59-26e7983b1006 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:07.214415 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b202a4bf-40bc-4e10-8c59-26e7983b1006 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:07.214851 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b202a4bf-40bc-4e10-8c59-26e7983b1006 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:07.282993 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b202a4bf-40bc-4e10-8c59-26e7983b1006 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:07.291144 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b202a4bf-40bc-4e10-8c59-26e7983b1006 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1273 microversion: 2.1 time: 0.090379 Jul 21 22:41:07.291719 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 392/833] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:07 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:08.310171 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-690f3d56-9fac-4192-81a6-6072dc0fc246 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:08.310771 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-690f3d56-9fac-4192-81a6-6072dc0fc246 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:08.318251 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-690f3d56-9fac-4192-81a6-6072dc0fc246 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:08.319043 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-690f3d56-9fac-4192-81a6-6072dc0fc246 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:08.320233 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-690f3d56-9fac-4192-81a6-6072dc0fc246 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:08.321247 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-690f3d56-9fac-4192-81a6-6072dc0fc246 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:08.439554 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-690f3d56-9fac-4192-81a6-6072dc0fc246 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:08.448571 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-690f3d56-9fac-4192-81a6-6072dc0fc246 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1273 microversion: 2.1 time: 0.142982 Jul 21 22:41:08.449352 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 442/834] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:08 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:09.371540 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-0883368c-573b-409b-98c8-c777478e8870 req-bc9074e1-e132-43b8-85e2-e893876e0876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e62c55ba-f2d3-45f7-a180-f08d2e6b5400", "tag": "46b295d6-3fdb-4255-98c1-6947280efe8c"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:09.384451 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-0883368c-573b-409b-98c8-c777478e8870 req-bc9074e1-e132-43b8-85e2-e893876e0876 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:09.385141 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-0883368c-573b-409b-98c8-c777478e8870 req-bc9074e1-e132-43b8-85e2-e893876e0876 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:09.403221 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-0883368c-573b-409b-98c8-c777478e8870 req-bc9074e1-e132-43b8-85e2-e893876e0876 service nova] Creating event network-changed:46b295d6-3fdb-4255-98c1-6947280efe8c for instance e62c55ba-f2d3-45f7-a180-f08d2e6b5400 on hv-cinder-85069 Jul 21 22:41:09.409430 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-0883368c-573b-409b-98c8-c777478e8870 req-bc9074e1-e132-43b8-85e2-e893876e0876 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042013 Jul 21 22:41:09.410672 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 393/835] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:09.468042 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4fbbc2c8-83cf-49d9-86a2-a09f22f2b94c tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:09.468652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4fbbc2c8-83cf-49d9-86a2-a09f22f2b94c tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:09.476158 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4fbbc2c8-83cf-49d9-86a2-a09f22f2b94c tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:09.476797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4fbbc2c8-83cf-49d9-86a2-a09f22f2b94c tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:09.477716 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4fbbc2c8-83cf-49d9-86a2-a09f22f2b94c tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:09.478163 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4fbbc2c8-83cf-49d9-86a2-a09f22f2b94c tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:09.687857 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4fbbc2c8-83cf-49d9-86a2-a09f22f2b94c tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:09.699686 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4fbbc2c8-83cf-49d9-86a2-a09f22f2b94c tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1315 microversion: 2.1 time: 0.237661 Jul 21 22:41:09.701004 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 443/836] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:09 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:09.777391 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1974580016", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "networks": [{"uuid": "13be37bc-ff9c-4f00-a431-e00b54c1851d"}]}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:09.839838 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] validate_networks() for [('13be37bc-ff9c-4f00-a431-e00b54c1851d', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:41:10.207616 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:41:10.208033 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:41:10.208496 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:41:10.208899 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:41:10.209304 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:41:10.220395 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:10.220904 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:10.221682 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:10.222121 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:10.239876 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Getting quotas for project 69c3434a76c647f99f50778ec26ffd70. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:41:10.243935 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Getting quotas for user 36dcb01083d64210a3ddf86e0bda4287 and project 69c3434a76c647f99f50778ec26ffd70. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:41:10.256014 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:41:10.258364 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:41:10.306510 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-5dd602c5-639a-4d97-9c4e-7aaac9323724 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534672 Jul 21 22:41:10.308073 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 394/837] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:41:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 22:41:10.318099 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-184bc231-008e-4550-9faf-c794eeffb874 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:10.318773 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-184bc231-008e-4550-9faf-c794eeffb874 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:10.381732 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-184bc231-008e-4550-9faf-c794eeffb874 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:10.390417 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-184bc231-008e-4550-9faf-c794eeffb874 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1219 microversion: 2.1 time: 0.076303 Jul 21 22:41:10.391197 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 444/838] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:10 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:10.719669 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2a896867-e404-43c5-91a1-e1e6959e2568 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:10.720841 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2a896867-e404-43c5-91a1-e1e6959e2568 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:10.728861 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2a896867-e404-43c5-91a1-e1e6959e2568 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:10.729680 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2a896867-e404-43c5-91a1-e1e6959e2568 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:10.731090 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2a896867-e404-43c5-91a1-e1e6959e2568 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:10.731803 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2a896867-e404-43c5-91a1-e1e6959e2568 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:10.904108 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-2a896867-e404-43c5-91a1-e1e6959e2568 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:10.912266 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2a896867-e404-43c5-91a1-e1e6959e2568 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1315 microversion: 2.1 time: 0.197507 Jul 21 22:41:10.913900 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 395/839] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:10 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:11.411096 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e0b1dd29-b92f-467e-b1c0-451066af8d0a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:11.413598 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e0b1dd29-b92f-467e-b1c0-451066af8d0a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:11.422966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e0b1dd29-b92f-467e-b1c0-451066af8d0a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:11.423623 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e0b1dd29-b92f-467e-b1c0-451066af8d0a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:11.424593 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e0b1dd29-b92f-467e-b1c0-451066af8d0a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:11.425350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e0b1dd29-b92f-467e-b1c0-451066af8d0a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:11.504987 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-e0b1dd29-b92f-467e-b1c0-451066af8d0a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:11.517576 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e0b1dd29-b92f-467e-b1c0-451066af8d0a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1279 microversion: 2.1 time: 0.113475 Jul 21 22:41:11.518178 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 445/840] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:11 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1279 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:11.933300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6c12e34d-772c-49a5-ac31-10a4c6eeb7ca tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:11.934130 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-6c12e34d-772c-49a5-ac31-10a4c6eeb7ca tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:11.941111 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6c12e34d-772c-49a5-ac31-10a4c6eeb7ca tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:11.941904 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6c12e34d-772c-49a5-ac31-10a4c6eeb7ca tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:11.942943 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6c12e34d-772c-49a5-ac31-10a4c6eeb7ca tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:11.943519 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6c12e34d-772c-49a5-ac31-10a4c6eeb7ca tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:12.107901 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6c12e34d-772c-49a5-ac31-10a4c6eeb7ca tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:12.118029 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6c12e34d-772c-49a5-ac31-10a4c6eeb7ca tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1315 microversion: 2.1 time: 0.188821 Jul 21 22:41:12.118029 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 396/841] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:11 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:12.535670 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-77077b71-c753-45bb-9eae-48c7c6e0ca2a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:12.536369 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-77077b71-c753-45bb-9eae-48c7c6e0ca2a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:12.543192 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77077b71-c753-45bb-9eae-48c7c6e0ca2a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:12.543649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77077b71-c753-45bb-9eae-48c7c6e0ca2a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:12.544449 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77077b71-c753-45bb-9eae-48c7c6e0ca2a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:12.544885 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77077b71-c753-45bb-9eae-48c7c6e0ca2a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:12.690676 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-77077b71-c753-45bb-9eae-48c7c6e0ca2a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:12.699209 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-77077b71-c753-45bb-9eae-48c7c6e0ca2a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1319 microversion: 2.1 time: 0.166754 Jul 21 22:41:12.699995 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 446/842] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:12 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:12.801671 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-0e97b938-1e5c-4bf5-8816-ab2da3882866 req-51719a4b-e3b9-4838-a3b5-3e2727138916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99dc0533-1e30-4411-95bb-6b8588084cb8", "tag": "7391ffbb-2997-4d52-83ae-6057e200a6c4"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:12.813123 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-0e97b938-1e5c-4bf5-8816-ab2da3882866 req-51719a4b-e3b9-4838-a3b5-3e2727138916 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:12.813667 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-0e97b938-1e5c-4bf5-8816-ab2da3882866 req-51719a4b-e3b9-4838-a3b5-3e2727138916 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:12.826535 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-0e97b938-1e5c-4bf5-8816-ab2da3882866 req-51719a4b-e3b9-4838-a3b5-3e2727138916 service nova] Creating event network-changed:7391ffbb-2997-4d52-83ae-6057e200a6c4 for instance 99dc0533-1e30-4411-95bb-6b8588084cb8 on hv-cinder-85069 Jul 21 22:41:12.831808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-0e97b938-1e5c-4bf5-8816-ab2da3882866 req-51719a4b-e3b9-4838-a3b5-3e2727138916 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033736 Jul 21 22:41:12.832431 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 397/843] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:13.133882 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7a6a4590-60ae-4b09-a32e-7423d3a9aafa tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:13.135176 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7a6a4590-60ae-4b09-a32e-7423d3a9aafa tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:13.142207 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7a6a4590-60ae-4b09-a32e-7423d3a9aafa tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:13.142733 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7a6a4590-60ae-4b09-a32e-7423d3a9aafa tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:13.143773 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7a6a4590-60ae-4b09-a32e-7423d3a9aafa tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:13.144414 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7a6a4590-60ae-4b09-a32e-7423d3a9aafa tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:13.303260 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7a6a4590-60ae-4b09-a32e-7423d3a9aafa tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:13.312289 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7a6a4590-60ae-4b09-a32e-7423d3a9aafa tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1315 microversion: 2.1 time: 0.182368 Jul 21 22:41:13.312912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 447/844] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:13 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:13.718114 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9658c824-af10-4d0c-b166-4f1997551de9 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:13.719142 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-9658c824-af10-4d0c-b166-4f1997551de9 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:13.725565 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9658c824-af10-4d0c-b166-4f1997551de9 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:13.725909 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9658c824-af10-4d0c-b166-4f1997551de9 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:13.726780 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9658c824-af10-4d0c-b166-4f1997551de9 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:13.727283 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9658c824-af10-4d0c-b166-4f1997551de9 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:13.865727 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-9658c824-af10-4d0c-b166-4f1997551de9 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:13.873821 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-9658c824-af10-4d0c-b166-4f1997551de9 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1319 microversion: 2.1 time: 0.161441 Jul 21 22:41:13.874392 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 398/845] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:13 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:14.330406 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8502a2ad-debb-4df6-a043-15208202bd6e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:14.330933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8502a2ad-debb-4df6-a043-15208202bd6e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:14.336996 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8502a2ad-debb-4df6-a043-15208202bd6e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:14.337526 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8502a2ad-debb-4df6-a043-15208202bd6e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:14.338310 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8502a2ad-debb-4df6-a043-15208202bd6e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:14.338771 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8502a2ad-debb-4df6-a043-15208202bd6e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:14.478582 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8502a2ad-debb-4df6-a043-15208202bd6e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:14.486623 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8502a2ad-debb-4df6-a043-15208202bd6e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1315 microversion: 2.1 time: 0.160346 Jul 21 22:41:14.487226 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 448/846] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:14 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:14.891486 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d5202881-0943-4640-a983-0d430ced4931 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:14.892282 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d5202881-0943-4640-a983-0d430ced4931 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:14.898740 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d5202881-0943-4640-a983-0d430ced4931 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:14.899227 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d5202881-0943-4640-a983-0d430ced4931 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:14.900020 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d5202881-0943-4640-a983-0d430ced4931 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:14.900466 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d5202881-0943-4640-a983-0d430ced4931 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:15.052906 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d5202881-0943-4640-a983-0d430ced4931 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:15.060410 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d5202881-0943-4640-a983-0d430ced4931 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1319 microversion: 2.1 time: 0.173313 Jul 21 22:41:15.061347 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 399/847] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:14 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:15.504426 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-367d163d-8085-4430-aad8-fed10d111c26 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:15.505104 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-367d163d-8085-4430-aad8-fed10d111c26 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:15.512526 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-367d163d-8085-4430-aad8-fed10d111c26 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:15.513273 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-367d163d-8085-4430-aad8-fed10d111c26 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:15.514134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-367d163d-8085-4430-aad8-fed10d111c26 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:15.514680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-367d163d-8085-4430-aad8-fed10d111c26 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:15.652725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-367d163d-8085-4430-aad8-fed10d111c26 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:15.661222 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-367d163d-8085-4430-aad8-fed10d111c26 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1315 microversion: 2.1 time: 0.160580 Jul 21 22:41:15.661809 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 449/848] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:15 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:16.080728 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-066651df-5d5a-4a6f-9bce-d3016dcdf100 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:16.082476 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-066651df-5d5a-4a6f-9bce-d3016dcdf100 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:16.090476 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-066651df-5d5a-4a6f-9bce-d3016dcdf100 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:16.090929 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-066651df-5d5a-4a6f-9bce-d3016dcdf100 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:16.091753 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-066651df-5d5a-4a6f-9bce-d3016dcdf100 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:16.092193 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-066651df-5d5a-4a6f-9bce-d3016dcdf100 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:16.253566 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-bdf8d557-97c6-4a26-9ccc-5be53519bdb8 req-89858586-b394-4f18-b6c2-fa634d343130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62c55ba-f2d3-45f7-a180-f08d2e6b5400", "name": "network-vif-plugged", "status": "completed", "tag": "46b295d6-3fdb-4255-98c1-6947280efe8c"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:16.260345 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-066651df-5d5a-4a6f-9bce-d3016dcdf100 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:16.265382 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-bdf8d557-97c6-4a26-9ccc-5be53519bdb8 req-89858586-b394-4f18-b6c2-fa634d343130 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:16.266309 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-bdf8d557-97c6-4a26-9ccc-5be53519bdb8 req-89858586-b394-4f18-b6c2-fa634d343130 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:16.271658 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-066651df-5d5a-4a6f-9bce-d3016dcdf100 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1319 microversion: 2.1 time: 0.196005 Jul 21 22:41:16.284513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 400/849] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:16 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:16.293105 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-bdf8d557-97c6-4a26-9ccc-5be53519bdb8 req-89858586-b394-4f18-b6c2-fa634d343130 service nova] Creating event network-vif-plugged:46b295d6-3fdb-4255-98c1-6947280efe8c for instance e62c55ba-f2d3-45f7-a180-f08d2e6b5400 on hv-cinder-85069 Jul 21 22:41:16.298897 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-bdf8d557-97c6-4a26-9ccc-5be53519bdb8 req-89858586-b394-4f18-b6c2-fa634d343130 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049208 Jul 21 22:41:16.299801 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 450/850] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:16.677663 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2bdee660-7970-4c5f-a68d-517ab1ca6808 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:16.678270 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2bdee660-7970-4c5f-a68d-517ab1ca6808 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:16.685216 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2bdee660-7970-4c5f-a68d-517ab1ca6808 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:16.685668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2bdee660-7970-4c5f-a68d-517ab1ca6808 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:16.686451 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2bdee660-7970-4c5f-a68d-517ab1ca6808 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:16.686885 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2bdee660-7970-4c5f-a68d-517ab1ca6808 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:16.829766 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-2bdee660-7970-4c5f-a68d-517ab1ca6808 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:16.845904 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2bdee660-7970-4c5f-a68d-517ab1ca6808 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1315 microversion: 2.1 time: 0.171937 Jul 21 22:41:16.846628 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 401/851] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:16 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:17.291429 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-fa6836bd-992e-4b6c-a667-4ba08e575ef3 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:17.292190 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-fa6836bd-992e-4b6c-a667-4ba08e575ef3 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:17.298522 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fa6836bd-992e-4b6c-a667-4ba08e575ef3 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:17.298968 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fa6836bd-992e-4b6c-a667-4ba08e575ef3 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:17.299850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fa6836bd-992e-4b6c-a667-4ba08e575ef3 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:17.300292 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fa6836bd-992e-4b6c-a667-4ba08e575ef3 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:17.436498 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-fa6836bd-992e-4b6c-a667-4ba08e575ef3 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:17.444064 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-fa6836bd-992e-4b6c-a667-4ba08e575ef3 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1319 microversion: 2.1 time: 0.157162 Jul 21 22:41:17.444646 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 451/852] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:17 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:17.863721 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7d6f4693-f2eb-4762-8d71-be5eebf50f5e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:17.864315 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7d6f4693-f2eb-4762-8d71-be5eebf50f5e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:17.872334 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7d6f4693-f2eb-4762-8d71-be5eebf50f5e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:17.872790 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7d6f4693-f2eb-4762-8d71-be5eebf50f5e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:17.873564 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7d6f4693-f2eb-4762-8d71-be5eebf50f5e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:17.874010 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7d6f4693-f2eb-4762-8d71-be5eebf50f5e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.007154 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7d6f4693-f2eb-4762-8d71-be5eebf50f5e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:18.015979 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7d6f4693-f2eb-4762-8d71-be5eebf50f5e tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1463 microversion: 2.1 time: 0.156182 Jul 21 22:41:18.018196 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 402/853] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:17 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:18.058778 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-e14719fe-e33a-441c-a1f1-050c50654121 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:18.059317 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e14719fe-e33a-441c-a1f1-050c50654121 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:18.065499 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e14719fe-e33a-441c-a1f1-050c50654121 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:18.065955 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e14719fe-e33a-441c-a1f1-050c50654121 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.066731 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e14719fe-e33a-441c-a1f1-050c50654121 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:18.067389 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-e14719fe-e33a-441c-a1f1-050c50654121 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.092677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-e14719fe-e33a-441c-a1f1-050c50654121 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Going to try to terminate instance {{(pid=124498) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:41:18.180356 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-e14719fe-e33a-441c-a1f1-050c50654121 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 204 len: 0 microversion: 2.1 time: 0.125629 Jul 21 22:41:18.181393 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 452/854] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:41:18 2022] DELETE /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:41:18.190219 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-97702627-9c37-4070-af6f-396d28b3efeb tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:18.190954 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-97702627-9c37-4070-af6f-396d28b3efeb tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:18.197075 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-97702627-9c37-4070-af6f-396d28b3efeb tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:18.197665 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-97702627-9c37-4070-af6f-396d28b3efeb tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.198647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-97702627-9c37-4070-af6f-396d28b3efeb tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:18.199236 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-97702627-9c37-4070-af6f-396d28b3efeb tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.318739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-ce69d0af-8c2e-4d32-a29e-99c6f9111e5d req-49bef888-8ff9-4b42-9efd-af997d6f8399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99dc0533-1e30-4411-95bb-6b8588084cb8", "name": "network-vif-plugged", "status": "completed", "tag": "7391ffbb-2997-4d52-83ae-6057e200a6c4"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:18.328613 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-ce69d0af-8c2e-4d32-a29e-99c6f9111e5d req-49bef888-8ff9-4b42-9efd-af997d6f8399 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:18.329277 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-ce69d0af-8c2e-4d32-a29e-99c6f9111e5d req-49bef888-8ff9-4b42-9efd-af997d6f8399 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.331783 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-97702627-9c37-4070-af6f-396d28b3efeb tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:18.341720 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-ce69d0af-8c2e-4d32-a29e-99c6f9111e5d req-49bef888-8ff9-4b42-9efd-af997d6f8399 service nova] Creating event network-vif-plugged:7391ffbb-2997-4d52-83ae-6057e200a6c4 for instance 99dc0533-1e30-4411-95bb-6b8588084cb8 on hv-cinder-85069 Jul 21 22:41:18.341946 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-97702627-9c37-4070-af6f-396d28b3efeb tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1469 microversion: 2.1 time: 0.155547 Jul 21 22:41:18.342490 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 403/855] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:18 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:18.350448 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-ce69d0af-8c2e-4d32-a29e-99c6f9111e5d req-49bef888-8ff9-4b42-9efd-af997d6f8399 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035657 Jul 21 22:41:18.351079 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 453/856] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:18.462248 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-fb51f24a-a2e5-442d-9ffd-950f04927bd2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:18.462892 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-fb51f24a-a2e5-442d-9ffd-950f04927bd2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:18.469335 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fb51f24a-a2e5-442d-9ffd-950f04927bd2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:18.469789 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fb51f24a-a2e5-442d-9ffd-950f04927bd2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.470566 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fb51f24a-a2e5-442d-9ffd-950f04927bd2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:18.471007 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fb51f24a-a2e5-442d-9ffd-950f04927bd2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.607747 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-fb51f24a-a2e5-442d-9ffd-950f04927bd2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:18.615138 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-fb51f24a-a2e5-442d-9ffd-950f04927bd2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1319 microversion: 2.1 time: 0.156798 Jul 21 22:41:18.615725 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 404/857] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:18 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:19.360056 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6037ccc9-78aa-4bf7-83c4-7a523c7cf600 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:19.360821 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6037ccc9-78aa-4bf7-83c4-7a523c7cf600 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:19.367569 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6037ccc9-78aa-4bf7-83c4-7a523c7cf600 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:19.368017 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6037ccc9-78aa-4bf7-83c4-7a523c7cf600 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:19.368792 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6037ccc9-78aa-4bf7-83c4-7a523c7cf600 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:19.369232 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6037ccc9-78aa-4bf7-83c4-7a523c7cf600 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:19.507913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6037ccc9-78aa-4bf7-83c4-7a523c7cf600 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:19.516836 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6037ccc9-78aa-4bf7-83c4-7a523c7cf600 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1469 microversion: 2.1 time: 0.160867 Jul 21 22:41:19.517432 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 454/858] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:19 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:19.632181 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4e855d8a-2d63-4959-8c16-a19c63c14db8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:19.632728 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4e855d8a-2d63-4959-8c16-a19c63c14db8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:19.640126 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4e855d8a-2d63-4959-8c16-a19c63c14db8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:19.640582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4e855d8a-2d63-4959-8c16-a19c63c14db8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:19.641372 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4e855d8a-2d63-4959-8c16-a19c63c14db8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:19.641814 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4e855d8a-2d63-4959-8c16-a19c63c14db8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:19.780598 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-4e855d8a-2d63-4959-8c16-a19c63c14db8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:19.788216 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4e855d8a-2d63-4959-8c16-a19c63c14db8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1319 microversion: 2.1 time: 0.160063 Jul 21 22:41:19.788778 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 405/859] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:19 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:20.139832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-4e5232e0-574d-4c7a-b1df-a5a76710c94e req-34a4741e-7d56-4cca-b077-f2cb7dd0246e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62c55ba-f2d3-45f7-a180-f08d2e6b5400", "name": "network-vif-deleted", "tag": "46b295d6-3fdb-4255-98c1-6947280efe8c"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:20.150199 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-4e5232e0-574d-4c7a-b1df-a5a76710c94e req-34a4741e-7d56-4cca-b077-f2cb7dd0246e service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.150569 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-4e5232e0-574d-4c7a-b1df-a5a76710c94e req-34a4741e-7d56-4cca-b077-f2cb7dd0246e service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.164090 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-4e5232e0-574d-4c7a-b1df-a5a76710c94e req-34a4741e-7d56-4cca-b077-f2cb7dd0246e service nova] Creating event network-vif-deleted:46b295d6-3fdb-4255-98c1-6947280efe8c for instance e62c55ba-f2d3-45f7-a180-f08d2e6b5400 on hv-cinder-85069 Jul 21 22:41:20.169141 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-4e5232e0-574d-4c7a-b1df-a5a76710c94e req-34a4741e-7d56-4cca-b077-f2cb7dd0246e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034690 Jul 21 22:41:20.170362 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 455/860] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:20.534291 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2258315f-fa72-4876-9940-955b0a9eb9e5 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:20.534903 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2258315f-fa72-4876-9940-955b0a9eb9e5 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:20.536871 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=4 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:20.537699 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=12 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:20.542856 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2258315f-fa72-4876-9940-955b0a9eb9e5 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.543506 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2258315f-fa72-4876-9940-955b0a9eb9e5 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.544303 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2258315f-fa72-4876-9940-955b0a9eb9e5 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.544721 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2258315f-fa72-4876-9940-955b0a9eb9e5 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.578149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2258315f-fa72-4876-9940-955b0a9eb9e5 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.578591 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2258315f-fa72-4876-9940-955b0a9eb9e5 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.579034 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-2258315f-fa72-4876-9940-955b0a9eb9e5 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lazy-loading 'fault' on Instance uuid e62c55ba-f2d3-45f7-a180-f08d2e6b5400 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:41:20.620217 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-2258315f-fa72-4876-9940-955b0a9eb9e5 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00304ab3aada47ccb0756d40b5484ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1af09e3e2b40be92caf9c0ef51b099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:20.628281 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2258315f-fa72-4876-9940-955b0a9eb9e5 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 200 len: 1305 microversion: 2.1 time: 0.097892 Jul 21 22:41:20.628857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 406/861] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:20 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:20.803045 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=4 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:20.808012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8f9c4d0a-b8f5-4514-a98f-34995829c65d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:20.808649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8f9c4d0a-b8f5-4514-a98f-34995829c65d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:20.816046 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8f9c4d0a-b8f5-4514-a98f-34995829c65d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.816493 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8f9c4d0a-b8f5-4514-a98f-34995829c65d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.817271 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8f9c4d0a-b8f5-4514-a98f-34995829c65d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.817725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8f9c4d0a-b8f5-4514-a98f-34995829c65d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.959533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8f9c4d0a-b8f5-4514-a98f-34995829c65d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:20.967629 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8f9c4d0a-b8f5-4514-a98f-34995829c65d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1507 microversion: 2.1 time: 0.165530 Jul 21 22:41:20.968209 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 456/862] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:20 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:21.645633 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-19aa5475-b194-45b8-accc-dae441982dc7 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:21.646239 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-19aa5475-b194-45b8-accc-dae441982dc7 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] [instance: e62c55ba-f2d3-45f7-a180-f08d2e6b5400] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:21.653327 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-19aa5475-b194-45b8-accc-dae441982dc7 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:21.653774 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-19aa5475-b194-45b8-accc-dae441982dc7 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:21.654535 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-19aa5475-b194-45b8-accc-dae441982dc7 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:21.654970 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-19aa5475-b194-45b8-accc-dae441982dc7 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:21.670740 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-19aa5475-b194-45b8-accc-dae441982dc7 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] HTTP exception thrown: Instance e62c55ba-f2d3-45f7-a180-f08d2e6b5400 could not be found. Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-19aa5475-b194-45b8-accc-dae441982dc7 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Request method failure captured: Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 HTTP/1.1 Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dX_n80ehUR9HZmsqkr6hP5x7mZuL_VTBrkfNWNRgCiTYe9QkHgivJkXB_e61mq9GSI854nzJrWMY8ya03Va4i2EXVPaQz7zNm9N6M2E42iY_PMsUyGpKzH6RrQq49jlIfsAYkMCddDAdNl2LZ5QhgoRxcI-wrxbtnmt39bQHzR8J9c Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 4d1af09e3e2b40be92caf9c0ef51b099 Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-VolumesNegativeTest-1481488210 Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:41:21.672413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d1af09e3e2b40be92caf9c0ef51b099"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d1af09e3e2b40be92caf9c0ef51b099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4d1af09e3e2b40be92caf9c0ef51b099", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4d1af09e3e2b40be92caf9c0ef51b099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-VolumesNegativeTest-1481488210 Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 4d1af09e3e2b40be92caf9c0ef51b099 Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-VolumesNegativeTest-1481488210 Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-VolumesNegativeTest-1481488210-project Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 00304ab3aada47ccb0756d40b5484ea3 Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-VolumesNegativeTest-1481488210-project Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance e62c55ba-f2d3-45f7-a180-f08d2e6b5400 could not be found. Jul 21 22:41:21.674604 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'e62c55ba-f2d3-45f7-a180-f08d2e6b5400'} Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e62c55ba-f2d3-45f7-a180-f08d2e6b5400 could not be found. Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:41:21.675726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e62c55ba-f2d3-45f7-a180-f08d2e6b5400 could not be found. Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e62c55ba-f2d3-45f7-a180-f08d2e6b5400 could not be found. Jul 21 22:41:21.677477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:41:21.679076 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-19aa5475-b194-45b8-accc-dae441982dc7 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] Returning 404 to user: Instance e62c55ba-f2d3-45f7-a180-f08d2e6b5400 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:41:21.679076 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-19aa5475-b194-45b8-accc-dae441982dc7 tempest-VolumesNegativeTest-1481488210 tempest-VolumesNegativeTest-1481488210-project] 10.222.0.58 "GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400" status: 404 len: 111 microversion: 2.1 time: 0.031984 Jul 21 22:41:21.679076 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 407/863] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:21 2022] GET /compute/v2.1/servers/e62c55ba-f2d3-45f7-a180-f08d2e6b5400 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:41:36.320797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d942bbc7-6d4c-4461-a717-5a41d65b850f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1265c91b-0cf5-4c86-a855-75f6c3f2f3f1", "device": "/dev/sdb"}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:36.322420 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d942bbc7-6d4c-4461-a717-5a41d65b850f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:36.334577 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:36.335328 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:36.341047 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d942bbc7-6d4c-4461-a717-5a41d65b850f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:36.341714 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d942bbc7-6d4c-4461-a717-5a41d65b850f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:36.342690 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d942bbc7-6d4c-4461-a717-5a41d65b850f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:36.343337 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d942bbc7-6d4c-4461-a717-5a41d65b850f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:36.696728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d942bbc7-6d4c-4461-a717-5a41d65b850f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "POST /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379806 Jul 21 22:41:36.703996 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 457/864] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:41:36 2022] POST /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:37.159931 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:37.160867 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=84 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:37.360831 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c4648f58-7363-41e5-8039-9d221f102342 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Action: 'create', calling method: .version_select at 0x7f47e65ed700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-67081037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWLUD/u+cGOE7WWNyMozhCsJBIq+n4WzqDnsxWKB+RT8eFnoGGlNwMZ0aaWD1IqhwXdtG/tXAlhwHmFOice+4Wen8mV4l/8/Ur9p1Oc1PRq3HCBsU9R/U3kZ7RszxUeDw=="}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:37.376365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-c4648f58-7363-41e5-8039-9d221f102342 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Getting quotas for project e61e273f945e45f0a6e1f3b45e4bc9d2. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:41:37.380260 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-c4648f58-7363-41e5-8039-9d221f102342 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Getting quotas for user a367906e74654507aaed8b885d525a0f and project e61e273f945e45f0a6e1f3b45e4bc9d2. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:41:37.403226 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c4648f58-7363-41e5-8039-9d221f102342 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.248442 Jul 21 22:41:37.403779 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 408/865] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 22:41:37 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:57.943961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:57.944729 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:57.948916 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1178632472", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-67081037", "security_groups": [{"name": "tempest-secgroup-smoke-1368037390"}], "block_device_mapping_v2": [{"uuid": "27e18aa7-f981-4cd6-ba4a-1f98f531b494", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "60f1b2e3-fd49-40e5-9c63-36eb47bcf006"}]}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:58.064389 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.network.neutron [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] validate_networks() for [('60f1b2e3-fd49-40e5-9c63-36eb47bcf006', None, None, None, None, None)] {{(pid=124498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:41:58.437439 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Flavor limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:41:58.438068 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Image limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:41:58.438977 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Flavor pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:41:58.439519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Image pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:41:58.440257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:41:58.449978 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:58.450532 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:58.451475 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:58.451972 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:58.470361 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Getting quotas for project e61e273f945e45f0a6e1f3b45e4bc9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:41:58.474315 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Getting quotas for user a367906e74654507aaed8b885d525a0f and project e61e273f945e45f0a6e1f3b45e4bc9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:41:58.542670 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Going to run 1 instances... {{(pid=124498) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:41:58.544922 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='27e18aa7-f981-4cd6-ba4a-1f98f531b494',volume_size=None,volume_type=None)] {{(pid=124498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:41:58.671918 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0d9f12b6-abcd-4db7-8184-5b92d3400a0d tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.729352 Jul 21 22:41:58.672757 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 458/866] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:41:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:41:58.683066 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-06ad4b52-f65d-456a-ac55-653e638371ed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:58.683689 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-06ad4b52-f65d-456a-ac55-653e638371ed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:58.685821 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=4 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:58.686460 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:58.746252 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-06ad4b52-f65d-456a-ac55-653e638371ed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:58.753635 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-06ad4b52-f65d-456a-ac55-653e638371ed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1093 microversion: 2.1 time: 0.074822 Jul 21 22:41:58.754205 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 409/867] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:58 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:59.491141 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cd6cc02c-7088-4d0e-ac6d-f119351278b2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:59.491647 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-cd6cc02c-7088-4d0e-ac6d-f119351278b2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:59.497906 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cd6cc02c-7088-4d0e-ac6d-f119351278b2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:59.498347 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cd6cc02c-7088-4d0e-ac6d-f119351278b2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:59.499133 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cd6cc02c-7088-4d0e-ac6d-f119351278b2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:59.499573 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cd6cc02c-7088-4d0e-ac6d-f119351278b2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:59.585735 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-cd6cc02c-7088-4d0e-ac6d-f119351278b2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lazy-loading 'services' on Instance uuid 99dc0533-1e30-4411-95bb-6b8588084cb8 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:41:59.667754 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-cd6cc02c-7088-4d0e-ac6d-f119351278b2 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8/os-volume_attachments/1265c91b-0cf5-4c86-a855-75f6c3f2f3f1" status: 202 len: 0 microversion: 2.1 time: 0.180703 Jul 21 22:41:59.672032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 459/868] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:41:59 2022] DELETE /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8/os-volume_attachments/1265c91b-0cf5-4c86-a855-75f6c3f2f3f1 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:41:59.770850 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5f3d3067-26e2-4c07-8e37-f9d5f40b12bd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:59.771618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5f3d3067-26e2-4c07-8e37-f9d5f40b12bd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:59.780825 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5f3d3067-26e2-4c07-8e37-f9d5f40b12bd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:59.783263 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5f3d3067-26e2-4c07-8e37-f9d5f40b12bd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:59.784382 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5f3d3067-26e2-4c07-8e37-f9d5f40b12bd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:59.785976 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5f3d3067-26e2-4c07-8e37-f9d5f40b12bd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:59.855126 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-5f3d3067-26e2-4c07-8e37-f9d5f40b12bd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:59.863942 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-5f3d3067-26e2-4c07-8e37-f9d5f40b12bd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1209 microversion: 2.1 time: 0.097171 Jul 21 22:41:59.864130 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 410/869] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:59 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:00.882121 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2594e6a2-1724-4b14-a0c4-9ed1a3e0fa1e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:00.882943 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2594e6a2-1724-4b14-a0c4-9ed1a3e0fa1e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:00.899299 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2594e6a2-1724-4b14-a0c4-9ed1a3e0fa1e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:00.899831 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2594e6a2-1724-4b14-a0c4-9ed1a3e0fa1e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:00.900662 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2594e6a2-1724-4b14-a0c4-9ed1a3e0fa1e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:00.903488 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2594e6a2-1724-4b14-a0c4-9ed1a3e0fa1e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.063398 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2594e6a2-1724-4b14-a0c4-9ed1a3e0fa1e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:01.078319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2594e6a2-1724-4b14-a0c4-9ed1a3e0fa1e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.200633 Jul 21 22:42:01.080451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 460/870] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:00 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:01.150727 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-e012adc7-1bbf-413e-89da-4ad04cd153f5 req-8d8507d4-b80f-4968-bb4f-11ff4bcc832f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a280f0d7-0ea3-4377-898d-14c4b0d8a929", "tag": "0688abfa-d32e-4d9a-9493-aa5974aaa63f"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:01.177737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-e012adc7-1bbf-413e-89da-4ad04cd153f5 req-8d8507d4-b80f-4968-bb4f-11ff4bcc832f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.178377 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-e012adc7-1bbf-413e-89da-4ad04cd153f5 req-8d8507d4-b80f-4968-bb4f-11ff4bcc832f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.190747 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-e012adc7-1bbf-413e-89da-4ad04cd153f5 req-8d8507d4-b80f-4968-bb4f-11ff4bcc832f service nova] Creating event network-changed:0688abfa-d32e-4d9a-9493-aa5974aaa63f for instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 on hv-cinder-85069 Jul 21 22:42:01.196176 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-e012adc7-1bbf-413e-89da-4ad04cd153f5 req-8d8507d4-b80f-4968-bb4f-11ff4bcc832f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052538 Jul 21 22:42:01.197047 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 411/871] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:01.867032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-80bb4e41-e308-43f5-b5da-5c2f6f5ddff5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:01.867550 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-80bb4e41-e308-43f5-b5da-5c2f6f5ddff5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:01.873456 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-80bb4e41-e308-43f5-b5da-5c2f6f5ddff5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.873905 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-80bb4e41-e308-43f5-b5da-5c2f6f5ddff5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.874667 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-80bb4e41-e308-43f5-b5da-5c2f6f5ddff5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.875124 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-80bb4e41-e308-43f5-b5da-5c2f6f5ddff5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.902897 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-80bb4e41-e308-43f5-b5da-5c2f6f5ddff5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Going to try to terminate instance {{(pid=124498) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:42:01.981940 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-80bb4e41-e308-43f5-b5da-5c2f6f5ddff5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 204 len: 0 microversion: 2.1 time: 0.118400 Jul 21 22:42:01.982745 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 461/872] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:42:01 2022] DELETE /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:42:01.992144 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-76979688-5edd-4f8d-bae5-d115e69fea1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:01.992988 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-76979688-5edd-4f8d-bae5-d115e69fea1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:01.999140 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76979688-5edd-4f8d-bae5-d115e69fea1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.999587 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76979688-5edd-4f8d-bae5-d115e69fea1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.000360 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76979688-5edd-4f8d-bae5-d115e69fea1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.000884 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-76979688-5edd-4f8d-bae5-d115e69fea1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.098232 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c89f1fbf-4994-49cb-a21d-e5b7a2265108 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:02.098958 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c89f1fbf-4994-49cb-a21d-e5b7a2265108 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:02.104895 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c89f1fbf-4994-49cb-a21d-e5b7a2265108 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.105346 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c89f1fbf-4994-49cb-a21d-e5b7a2265108 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.106114 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c89f1fbf-4994-49cb-a21d-e5b7a2265108 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.106553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c89f1fbf-4994-49cb-a21d-e5b7a2265108 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.135002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-76979688-5edd-4f8d-bae5-d115e69fea1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:02.144427 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-76979688-5edd-4f8d-bae5-d115e69fea1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1513 microversion: 2.1 time: 0.156504 Jul 21 22:42:02.145006 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 412/873] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:01 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:02.244771 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-c89f1fbf-4994-49cb-a21d-e5b7a2265108 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:02.252217 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c89f1fbf-4994-49cb-a21d-e5b7a2265108 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.159108 Jul 21 22:42:02.252774 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 462/874] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:02 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:03.162194 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-16ebe772-63a8-4081-abc3-bbe90f58a7c8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:03.162806 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-16ebe772-63a8-4081-abc3-bbe90f58a7c8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:03.169577 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-16ebe772-63a8-4081-abc3-bbe90f58a7c8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:03.170020 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-16ebe772-63a8-4081-abc3-bbe90f58a7c8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:03.170775 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-16ebe772-63a8-4081-abc3-bbe90f58a7c8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:03.171246 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-16ebe772-63a8-4081-abc3-bbe90f58a7c8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:03.270041 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-29376cbe-2ca4-4909-ada4-2408c8b13750 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:03.270739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-29376cbe-2ca4-4909-ada4-2408c8b13750 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:03.277661 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29376cbe-2ca4-4909-ada4-2408c8b13750 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:03.278115 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29376cbe-2ca4-4909-ada4-2408c8b13750 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:03.278882 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29376cbe-2ca4-4909-ada4-2408c8b13750 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:03.279342 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29376cbe-2ca4-4909-ada4-2408c8b13750 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:03.306188 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-16ebe772-63a8-4081-abc3-bbe90f58a7c8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:03.315046 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-16ebe772-63a8-4081-abc3-bbe90f58a7c8 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1513 microversion: 2.1 time: 0.156688 Jul 21 22:42:03.315647 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 413/875] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:03 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:03.445720 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-29376cbe-2ca4-4909-ada4-2408c8b13750 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:03.454211 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-29376cbe-2ca4-4909-ada4-2408c8b13750 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.187998 Jul 21 22:42:03.454895 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 463/876] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:03 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:04.022728 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-cf6d2850-a5f4-4628-a754-60edcb61f26c req-2d0e75ea-d0c8-4d4b-8bfa-7b1fdf9d832b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99dc0533-1e30-4411-95bb-6b8588084cb8", "name": "network-vif-deleted", "tag": "7391ffbb-2997-4d52-83ae-6057e200a6c4"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:04.034282 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-cf6d2850-a5f4-4628-a754-60edcb61f26c req-2d0e75ea-d0c8-4d4b-8bfa-7b1fdf9d832b service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.034735 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-cf6d2850-a5f4-4628-a754-60edcb61f26c req-2d0e75ea-d0c8-4d4b-8bfa-7b1fdf9d832b service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.046473 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-cf6d2850-a5f4-4628-a754-60edcb61f26c req-2d0e75ea-d0c8-4d4b-8bfa-7b1fdf9d832b service nova] Creating event network-vif-deleted:7391ffbb-2997-4d52-83ae-6057e200a6c4 for instance 99dc0533-1e30-4411-95bb-6b8588084cb8 on hv-cinder-85069 Jul 21 22:42:04.051377 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-cf6d2850-a5f4-4628-a754-60edcb61f26c req-2d0e75ea-d0c8-4d4b-8bfa-7b1fdf9d832b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032248 Jul 21 22:42:04.051978 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 414/877] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:04.333160 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-28670657-103c-4742-a5e8-51f551e76016 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:04.333889 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-28670657-103c-4742-a5e8-51f551e76016 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:04.340287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-28670657-103c-4742-a5e8-51f551e76016 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.340727 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-28670657-103c-4742-a5e8-51f551e76016 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.341476 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-28670657-103c-4742-a5e8-51f551e76016 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.341931 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-28670657-103c-4742-a5e8-51f551e76016 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.378331 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-28670657-103c-4742-a5e8-51f551e76016 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.378782 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-28670657-103c-4742-a5e8-51f551e76016 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.379259 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-28670657-103c-4742-a5e8-51f551e76016 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lazy-loading 'fault' on Instance uuid 99dc0533-1e30-4411-95bb-6b8588084cb8 {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:42:04.429536 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-28670657-103c-4742-a5e8-51f551e76016 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:04.438662 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-28670657-103c-4742-a5e8-51f551e76016 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 200 len: 1309 microversion: 2.1 time: 0.109184 Jul 21 22:42:04.439428 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 464/878] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:04 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:04.471683 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-45e4ce18-fa6e-4207-a470-253a3de96198 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:04.473049 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-45e4ce18-fa6e-4207-a470-253a3de96198 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:04.480360 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-45e4ce18-fa6e-4207-a470-253a3de96198 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.480819 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-45e4ce18-fa6e-4207-a470-253a3de96198 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.481609 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-45e4ce18-fa6e-4207-a470-253a3de96198 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.482056 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-45e4ce18-fa6e-4207-a470-253a3de96198 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.620056 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-45e4ce18-fa6e-4207-a470-253a3de96198 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:04.627671 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-45e4ce18-fa6e-4207-a470-253a3de96198 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.160581 Jul 21 22:42:04.628237 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 415/879] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:04 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:05.456966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b4e94e49-11ef-4ef8-87d8-90905ff9e237 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:05.457595 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b4e94e49-11ef-4ef8-87d8-90905ff9e237 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 99dc0533-1e30-4411-95bb-6b8588084cb8] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:05.464036 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4e94e49-11ef-4ef8-87d8-90905ff9e237 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:05.464516 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4e94e49-11ef-4ef8-87d8-90905ff9e237 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:05.465272 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4e94e49-11ef-4ef8-87d8-90905ff9e237 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:05.465705 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4e94e49-11ef-4ef8-87d8-90905ff9e237 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:05.480483 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-b4e94e49-11ef-4ef8-87d8-90905ff9e237 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] HTTP exception thrown: Instance 99dc0533-1e30-4411-95bb-6b8588084cb8 could not be found. Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b4e94e49-11ef-4ef8-87d8-90905ff9e237 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Request method failure captured: Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 HTTP/1.1 Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dYDaRUW_D6eMWxNJGoCJIXLV2aQf4T0qx-Uu0GW02jVG5q2NHJ1ewKlmX3ANBbDLLDg1nt3m5rg8-avUcN8Gqtchr5Np7rQYtZeQ_8054Mj3bGQrRIc2FrVCqvOGnYnXYT78BSBe58jXo_6jlpD0TpiQP81ngkrgvmFYPK9FKkNsWk Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 69c3434a76c647f99f50778ec26ffd70 Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1992434964 Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:42:05.482130 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69c3434a76c647f99f50778ec26ffd70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69c3434a76c647f99f50778ec26ffd70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69c3434a76c647f99f50778ec26ffd70", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69c3434a76c647f99f50778ec26ffd70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-VolumesSnapshotTestJSON-1992434964 Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 69c3434a76c647f99f50778ec26ffd70 Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1992434964 Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-VolumesSnapshotTestJSON-1992434964-project Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: 36dcb01083d64210a3ddf86e0bda4287 Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-VolumesSnapshotTestJSON-1992434964-project Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 99dc0533-1e30-4411-95bb-6b8588084cb8 could not be found. Jul 21 22:42:05.483894 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '99dc0533-1e30-4411-95bb-6b8588084cb8'} Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99dc0533-1e30-4411-95bb-6b8588084cb8 could not be found. Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:42:05.485685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99dc0533-1e30-4411-95bb-6b8588084cb8 could not be found. Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99dc0533-1e30-4411-95bb-6b8588084cb8 could not be found. Jul 21 22:42:05.487452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:42:05.489118 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b4e94e49-11ef-4ef8-87d8-90905ff9e237 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Returning 404 to user: Instance 99dc0533-1e30-4411-95bb-6b8588084cb8 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:42:05.489118 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b4e94e49-11ef-4ef8-87d8-90905ff9e237 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8" status: 404 len: 111 microversion: 2.1 time: 0.031073 Jul 21 22:42:05.489118 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 465/880] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:05 2022] GET /compute/v2.1/servers/99dc0533-1e30-4411-95bb-6b8588084cb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:42:05.645328 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5420aace-3fe5-4ed1-9736-260069dda136 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:05.646124 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5420aace-3fe5-4ed1-9736-260069dda136 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:05.652443 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5420aace-3fe5-4ed1-9736-260069dda136 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:05.652902 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5420aace-3fe5-4ed1-9736-260069dda136 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:05.653688 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5420aace-3fe5-4ed1-9736-260069dda136 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:05.654823 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5420aace-3fe5-4ed1-9736-260069dda136 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:05.797167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-5420aace-3fe5-4ed1-9736-260069dda136 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:05.804724 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-5420aace-3fe5-4ed1-9736-260069dda136 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.164089 Jul 21 22:42:05.805291 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 416/881] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:05 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:06.820761 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b19439e8-5b45-418f-82ec-1ba5f09143b1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:06.821368 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b19439e8-5b45-418f-82ec-1ba5f09143b1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:06.827430 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b19439e8-5b45-418f-82ec-1ba5f09143b1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:06.827872 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b19439e8-5b45-418f-82ec-1ba5f09143b1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:06.829000 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b19439e8-5b45-418f-82ec-1ba5f09143b1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:06.829146 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b19439e8-5b45-418f-82ec-1ba5f09143b1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:06.962759 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b19439e8-5b45-418f-82ec-1ba5f09143b1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:06.970964 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b19439e8-5b45-418f-82ec-1ba5f09143b1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.154253 Jul 21 22:42:06.971553 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 466/882] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:06 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:07.987584 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-676c4b9f-440e-4cf2-bf4d-bdbf7de1791b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:07.988182 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-676c4b9f-440e-4cf2-bf4d-bdbf7de1791b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:07.994589 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-676c4b9f-440e-4cf2-bf4d-bdbf7de1791b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:07.995026 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-676c4b9f-440e-4cf2-bf4d-bdbf7de1791b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:07.995808 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-676c4b9f-440e-4cf2-bf4d-bdbf7de1791b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:07.996235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-676c4b9f-440e-4cf2-bf4d-bdbf7de1791b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:08.127986 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-676c4b9f-440e-4cf2-bf4d-bdbf7de1791b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:08.135514 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-676c4b9f-440e-4cf2-bf4d-bdbf7de1791b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.152275 Jul 21 22:42:08.136089 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 417/883] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:07 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:09.152609 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-081a9e8c-3836-4d9d-a1be-2c6c59bd5eed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:09.153251 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-081a9e8c-3836-4d9d-a1be-2c6c59bd5eed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:09.155698 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:09.156999 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=6 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:09.163167 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-081a9e8c-3836-4d9d-a1be-2c6c59bd5eed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:09.163617 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-081a9e8c-3836-4d9d-a1be-2c6c59bd5eed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:09.164393 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-081a9e8c-3836-4d9d-a1be-2c6c59bd5eed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:09.164833 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-081a9e8c-3836-4d9d-a1be-2c6c59bd5eed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:09.306037 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-081a9e8c-3836-4d9d-a1be-2c6c59bd5eed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:09.314227 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-081a9e8c-3836-4d9d-a1be-2c6c59bd5eed tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.165453 Jul 21 22:42:09.314807 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 467/884] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:09 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:10.332145 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-28ee95c4-d903-4cf7-8a2f-9647d27a59e6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:10.332816 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-28ee95c4-d903-4cf7-8a2f-9647d27a59e6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:10.334711 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:10.340547 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-28ee95c4-d903-4cf7-8a2f-9647d27a59e6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:10.340987 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-28ee95c4-d903-4cf7-8a2f-9647d27a59e6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:10.341744 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-28ee95c4-d903-4cf7-8a2f-9647d27a59e6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:10.342174 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-28ee95c4-d903-4cf7-8a2f-9647d27a59e6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:10.478813 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-28ee95c4-d903-4cf7-8a2f-9647d27a59e6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:10.486726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-28ee95c4-d903-4cf7-8a2f-9647d27a59e6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.158560 Jul 21 22:42:10.487317 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 418/885] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:10 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:11.503803 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-60d05022-f313-4e92-bc65-275bc67ba2ca tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:11.504356 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-60d05022-f313-4e92-bc65-275bc67ba2ca tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:11.510710 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-60d05022-f313-4e92-bc65-275bc67ba2ca tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:11.511178 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-60d05022-f313-4e92-bc65-275bc67ba2ca tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:11.511931 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-60d05022-f313-4e92-bc65-275bc67ba2ca tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:11.512387 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-60d05022-f313-4e92-bc65-275bc67ba2ca tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:11.648658 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-60d05022-f313-4e92-bc65-275bc67ba2ca tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:11.656578 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-60d05022-f313-4e92-bc65-275bc67ba2ca tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.157389 Jul 21 22:42:11.657251 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 468/886] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:11 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:12.673843 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-c4498ef1-49a6-4c56-b6b6-75c42d01e4d9 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:12.674442 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-c4498ef1-49a6-4c56-b6b6-75c42d01e4d9 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:12.680924 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c4498ef1-49a6-4c56-b6b6-75c42d01e4d9 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:12.681370 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c4498ef1-49a6-4c56-b6b6-75c42d01e4d9 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:12.682129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c4498ef1-49a6-4c56-b6b6-75c42d01e4d9 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:12.682558 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-c4498ef1-49a6-4c56-b6b6-75c42d01e4d9 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:12.813348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-c4498ef1-49a6-4c56-b6b6-75c42d01e4d9 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:12.820656 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-c4498ef1-49a6-4c56-b6b6-75c42d01e4d9 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.150750 Jul 21 22:42:12.821217 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 419/887] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:12 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:13.330826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2012410853", "imageRef": "1b4d3363-395b-414d-9be3-ea5cc27e5f1e", "flavorRef": "452", "networks": [{"uuid": "13be37bc-ff9c-4f00-a431-e00b54c1851d"}]}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:13.388246 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.network.neutron [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] validate_networks() for [('13be37bc-ff9c-4f00-a431-e00b54c1851d', None, None, None, None, None)] {{(pid=124498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:42:13.737655 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Flavor limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:42:13.738066 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Image limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:42:13.738539 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Flavor pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:42:13.738932 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Image pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:42:13.739363 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:42:13.748688 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:13.749129 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:13.749952 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:13.750411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:13.768862 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Getting quotas for project 69c3434a76c647f99f50778ec26ffd70. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:42:13.772795 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Getting quotas for user 36dcb01083d64210a3ddf86e0bda4287 and project 69c3434a76c647f99f50778ec26ffd70. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:42:13.784970 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Going to run 1 instances... {{(pid=124498) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:42:13.787263 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b4d3363-395b-414d-9be3-ea5cc27e5f1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:42:13.834265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-57663f85-a4e5-4911-82b0-48cb965cee0e tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507935 Jul 21 22:42:13.840037 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 469/888] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:42:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:42:13.840126 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-18483c19-c184-4b97-a91d-90863423eef7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:13.840126 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-18483c19-c184-4b97-a91d-90863423eef7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:13.845683 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-1c15c6d6-e6dd-4be8-8fd5-39b41ba63fb5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:13.846307 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-1c15c6d6-e6dd-4be8-8fd5-39b41ba63fb5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:13.846606 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-18483c19-c184-4b97-a91d-90863423eef7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:13.847083 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-18483c19-c184-4b97-a91d-90863423eef7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:13.847872 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-18483c19-c184-4b97-a91d-90863423eef7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:13.855497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-18483c19-c184-4b97-a91d-90863423eef7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:13.904033 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-1c15c6d6-e6dd-4be8-8fd5-39b41ba63fb5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:13.912837 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-1c15c6d6-e6dd-4be8-8fd5-39b41ba63fb5 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1219 microversion: 2.1 time: 0.071997 Jul 21 22:42:13.913428 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 470/889] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:13 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:14.014232 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-18483c19-c184-4b97-a91d-90863423eef7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:14.022754 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-18483c19-c184-4b97-a91d-90863423eef7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.188767 Jul 21 22:42:14.023482 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 420/890] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:13 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:14.356711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-1284d430-f597-4d66-b9a4-fb825b6facad req-eafad07c-f039-45eb-9dff-3ad333b69882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a280f0d7-0ea3-4377-898d-14c4b0d8a929", "name": "network-vif-plugged", "status": "completed", "tag": "0688abfa-d32e-4d9a-9493-aa5974aaa63f"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:14.366525 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-1284d430-f597-4d66-b9a4-fb825b6facad req-eafad07c-f039-45eb-9dff-3ad333b69882 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:14.367372 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-1284d430-f597-4d66-b9a4-fb825b6facad req-eafad07c-f039-45eb-9dff-3ad333b69882 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:14.380561 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-1284d430-f597-4d66-b9a4-fb825b6facad req-eafad07c-f039-45eb-9dff-3ad333b69882 service nova] Creating event network-vif-plugged:0688abfa-d32e-4d9a-9493-aa5974aaa63f for instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 on hv-cinder-85069 Jul 21 22:42:14.385518 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-1284d430-f597-4d66-b9a4-fb825b6facad req-eafad07c-f039-45eb-9dff-3ad333b69882 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032576 Jul 21 22:42:14.386741 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 471/891] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:14.931129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-23243af9-2ce3-4b34-ad75-bf5f0f8f2aaf tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:14.931849 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-23243af9-2ce3-4b34-ad75-bf5f0f8f2aaf tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:14.939355 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-23243af9-2ce3-4b34-ad75-bf5f0f8f2aaf tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:14.939894 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-23243af9-2ce3-4b34-ad75-bf5f0f8f2aaf tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:14.940729 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-23243af9-2ce3-4b34-ad75-bf5f0f8f2aaf tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:14.941209 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-23243af9-2ce3-4b34-ad75-bf5f0f8f2aaf tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:15.005571 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-23243af9-2ce3-4b34-ad75-bf5f0f8f2aaf tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:15.013306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-23243af9-2ce3-4b34-ad75-bf5f0f8f2aaf tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1277 microversion: 2.1 time: 0.086655 Jul 21 22:42:15.013865 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 421/892] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:14 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:15.043178 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6ef703a0-b597-43b8-ab3a-1c87fbe87c9c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:15.043887 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6ef703a0-b597-43b8-ab3a-1c87fbe87c9c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:15.050187 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ef703a0-b597-43b8-ab3a-1c87fbe87c9c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:15.050765 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ef703a0-b597-43b8-ab3a-1c87fbe87c9c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:15.051423 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ef703a0-b597-43b8-ab3a-1c87fbe87c9c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:15.051857 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ef703a0-b597-43b8-ab3a-1c87fbe87c9c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:15.187993 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6ef703a0-b597-43b8-ab3a-1c87fbe87c9c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:15.195797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6ef703a0-b597-43b8-ab3a-1c87fbe87c9c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1265 microversion: 2.1 time: 0.156776 Jul 21 22:42:15.196370 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 472/893] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:15 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:16.030470 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-72f8c976-9707-4bee-a2b8-0151606ab06d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:16.031130 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-72f8c976-9707-4bee-a2b8-0151606ab06d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:16.038818 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72f8c976-9707-4bee-a2b8-0151606ab06d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.039376 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72f8c976-9707-4bee-a2b8-0151606ab06d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.040225 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72f8c976-9707-4bee-a2b8-0151606ab06d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.040702 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-72f8c976-9707-4bee-a2b8-0151606ab06d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.183631 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-72f8c976-9707-4bee-a2b8-0151606ab06d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:16.194365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-72f8c976-9707-4bee-a2b8-0151606ab06d tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1319 microversion: 2.1 time: 0.167419 Jul 21 22:42:16.195511 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 422/894] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:16 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:16.213650 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0d888787-bafc-4b7d-8c84-94f8a9e5369a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:16.214325 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0d888787-bafc-4b7d-8c84-94f8a9e5369a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:16.221440 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d888787-bafc-4b7d-8c84-94f8a9e5369a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.221890 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d888787-bafc-4b7d-8c84-94f8a9e5369a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.222662 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d888787-bafc-4b7d-8c84-94f8a9e5369a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.223126 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d888787-bafc-4b7d-8c84-94f8a9e5369a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.319361 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-27f586d5-7ae3-47b3-94bb-e68f0310b4b3 req-83367f67-56b6-4fd3-9190-65fcbba2f3ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d80be9-e737-44b4-b737-a7650b9efe5f", "tag": "d5951f7e-7c96-4145-940b-1b5825dce885"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:16.330010 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-27f586d5-7ae3-47b3-94bb-e68f0310b4b3 req-83367f67-56b6-4fd3-9190-65fcbba2f3ef service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.330875 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-27f586d5-7ae3-47b3-94bb-e68f0310b4b3 req-83367f67-56b6-4fd3-9190-65fcbba2f3ef service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.346908 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-27f586d5-7ae3-47b3-94bb-e68f0310b4b3 req-83367f67-56b6-4fd3-9190-65fcbba2f3ef service nova] Creating event network-changed:d5951f7e-7c96-4145-940b-1b5825dce885 for instance 17d80be9-e737-44b4-b737-a7650b9efe5f on hv-cinder-85069 Jul 21 22:42:16.352196 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-27f586d5-7ae3-47b3-94bb-e68f0310b4b3 req-83367f67-56b6-4fd3-9190-65fcbba2f3ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044091 Jul 21 22:42:16.353422 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 423/895] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:16.379162 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-0d888787-bafc-4b7d-8c84-94f8a9e5369a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:16.386645 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0d888787-bafc-4b7d-8c84-94f8a9e5369a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1452 microversion: 2.1 time: 0.176844 Jul 21 22:42:16.387234 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 473/896] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:16 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:16.404374 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-05f3dd1a-576d-4d53-86ea-3c1f43d9008e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:16.405066 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-05f3dd1a-576d-4d53-86ea-3c1f43d9008e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:16.412612 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05f3dd1a-576d-4d53-86ea-3c1f43d9008e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.413061 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05f3dd1a-576d-4d53-86ea-3c1f43d9008e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.413850 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05f3dd1a-576d-4d53-86ea-3c1f43d9008e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.414270 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05f3dd1a-576d-4d53-86ea-3c1f43d9008e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.555494 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-05f3dd1a-576d-4d53-86ea-3c1f43d9008e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:16.563771 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-05f3dd1a-576d-4d53-86ea-3c1f43d9008e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1452 microversion: 2.1 time: 0.163553 Jul 21 22:42:16.575224 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 424/897] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:16 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:17.211238 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a7127099-2087-4c94-834e-ecac6de4bd48 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:17.211871 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a7127099-2087-4c94-834e-ecac6de4bd48 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:17.222429 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a7127099-2087-4c94-834e-ecac6de4bd48 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:17.223105 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a7127099-2087-4c94-834e-ecac6de4bd48 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:17.224337 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a7127099-2087-4c94-834e-ecac6de4bd48 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:17.224782 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a7127099-2087-4c94-834e-ecac6de4bd48 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:17.470118 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a7127099-2087-4c94-834e-ecac6de4bd48 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:17.477711 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a7127099-2087-4c94-834e-ecac6de4bd48 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1319 microversion: 2.1 time: 0.270442 Jul 21 22:42:17.478289 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 474/898] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:17 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:18.495633 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-ea5665b9-8da2-4963-909a-23fc0abe4f1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:18.496257 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-ea5665b9-8da2-4963-909a-23fc0abe4f1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:18.503347 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ea5665b9-8da2-4963-909a-23fc0abe4f1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:18.503814 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ea5665b9-8da2-4963-909a-23fc0abe4f1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:18.504601 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ea5665b9-8da2-4963-909a-23fc0abe4f1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:18.505178 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ea5665b9-8da2-4963-909a-23fc0abe4f1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:18.721837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-ea5665b9-8da2-4963-909a-23fc0abe4f1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:18.731352 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-ea5665b9-8da2-4963-909a-23fc0abe4f1a tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1319 microversion: 2.1 time: 0.239977 Jul 21 22:42:18.732108 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 425/899] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:18 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:18.798888 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-266a71c9-b73d-4327-80d2-7cc49249c510 req-437bc31a-770e-4fe8-b5e2-9d15c2a802b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a280f0d7-0ea3-4377-898d-14c4b0d8a929", "tag": "0688abfa-d32e-4d9a-9493-aa5974aaa63f"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:18.807141 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-266a71c9-b73d-4327-80d2-7cc49249c510 req-437bc31a-770e-4fe8-b5e2-9d15c2a802b9 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:18.807751 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-266a71c9-b73d-4327-80d2-7cc49249c510 req-437bc31a-770e-4fe8-b5e2-9d15c2a802b9 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:18.820011 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-266a71c9-b73d-4327-80d2-7cc49249c510 req-437bc31a-770e-4fe8-b5e2-9d15c2a802b9 service nova] Creating event network-changed:0688abfa-d32e-4d9a-9493-aa5974aaa63f for instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 on hv-cinder-85069 Jul 21 22:42:18.825032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-266a71c9-b73d-4327-80d2-7cc49249c510 req-437bc31a-770e-4fe8-b5e2-9d15c2a802b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095944 Jul 21 22:42:18.825710 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 475/900] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:19.748945 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-496c5844-b999-4f6d-a262-e5b910c663de tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:19.749541 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-496c5844-b999-4f6d-a262-e5b910c663de tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:19.756684 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-496c5844-b999-4f6d-a262-e5b910c663de tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:19.757129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-496c5844-b999-4f6d-a262-e5b910c663de tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:19.757939 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-496c5844-b999-4f6d-a262-e5b910c663de tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:19.758314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-496c5844-b999-4f6d-a262-e5b910c663de tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:19.897119 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-496c5844-b999-4f6d-a262-e5b910c663de tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:19.904936 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-496c5844-b999-4f6d-a262-e5b910c663de tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1319 microversion: 2.1 time: 0.159956 Jul 21 22:42:19.905500 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 426/901] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:19 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:20.922303 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-77d3a6e3-c458-4055-a4f4-f89928bf2291 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:20.922911 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-77d3a6e3-c458-4055-a4f4-f89928bf2291 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:20.929153 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77d3a6e3-c458-4055-a4f4-f89928bf2291 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:20.929590 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77d3a6e3-c458-4055-a4f4-f89928bf2291 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:20.930378 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77d3a6e3-c458-4055-a4f4-f89928bf2291 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:20.930804 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-77d3a6e3-c458-4055-a4f4-f89928bf2291 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:20.934815 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:21.063646 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-77d3a6e3-c458-4055-a4f4-f89928bf2291 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:21.070949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-77d3a6e3-c458-4055-a4f4-f89928bf2291 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1319 microversion: 2.1 time: 0.153525 Jul 21 22:42:21.071548 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 476/902] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:20 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:22.088507 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-075a708d-3bbb-417b-8280-58a4dfa72908 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:22.089118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-075a708d-3bbb-417b-8280-58a4dfa72908 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:22.096516 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-075a708d-3bbb-417b-8280-58a4dfa72908 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:22.096975 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-075a708d-3bbb-417b-8280-58a4dfa72908 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:22.097752 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-075a708d-3bbb-417b-8280-58a4dfa72908 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:22.098222 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-075a708d-3bbb-417b-8280-58a4dfa72908 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:22.239179 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-075a708d-3bbb-417b-8280-58a4dfa72908 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:22.247300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-075a708d-3bbb-417b-8280-58a4dfa72908 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1319 microversion: 2.1 time: 0.162561 Jul 21 22:42:22.247932 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 427/903] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:22 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:22.414535 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-4debee99-73e5-4add-a75e-0d8b585b5f32 req-d98ba3b4-6f8c-4279-b137-270c8b22f4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d80be9-e737-44b4-b737-a7650b9efe5f", "name": "network-vif-plugged", "status": "completed", "tag": "d5951f7e-7c96-4145-940b-1b5825dce885"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:22.424278 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-4debee99-73e5-4add-a75e-0d8b585b5f32 req-d98ba3b4-6f8c-4279-b137-270c8b22f4fa service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:22.424703 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-4debee99-73e5-4add-a75e-0d8b585b5f32 req-d98ba3b4-6f8c-4279-b137-270c8b22f4fa service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:22.436450 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-4debee99-73e5-4add-a75e-0d8b585b5f32 req-d98ba3b4-6f8c-4279-b137-270c8b22f4fa service nova] Creating event network-vif-plugged:d5951f7e-7c96-4145-940b-1b5825dce885 for instance 17d80be9-e737-44b4-b737-a7650b9efe5f on hv-cinder-85069 Jul 21 22:42:22.442100 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-4debee99-73e5-4add-a75e-0d8b585b5f32 req-d98ba3b4-6f8c-4279-b137-270c8b22f4fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031272 Jul 21 22:42:22.442760 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 477/904] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:23.264561 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f00f9d30-9559-4d94-9d1b-cd0d1a0a328c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:23.265217 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f00f9d30-9559-4d94-9d1b-cd0d1a0a328c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:23.272541 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f00f9d30-9559-4d94-9d1b-cd0d1a0a328c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:23.272993 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f00f9d30-9559-4d94-9d1b-cd0d1a0a328c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:23.273773 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f00f9d30-9559-4d94-9d1b-cd0d1a0a328c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:23.274217 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f00f9d30-9559-4d94-9d1b-cd0d1a0a328c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:23.293553 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=100 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:23.416216 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f00f9d30-9559-4d94-9d1b-cd0d1a0a328c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:23.424021 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f00f9d30-9559-4d94-9d1b-cd0d1a0a328c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1319 microversion: 2.1 time: 0.163582 Jul 21 22:42:23.424600 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 428/905] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:23 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:24.439656 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:24.440850 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=8 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:24.445938 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-39412a3b-c8ee-4d2c-b049-176dea3a2ff1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:24.446646 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-39412a3b-c8ee-4d2c-b049-176dea3a2ff1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:24.454338 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39412a3b-c8ee-4d2c-b049-176dea3a2ff1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:24.454804 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39412a3b-c8ee-4d2c-b049-176dea3a2ff1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:24.455599 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39412a3b-c8ee-4d2c-b049-176dea3a2ff1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:24.456034 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39412a3b-c8ee-4d2c-b049-176dea3a2ff1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:24.587284 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-39412a3b-c8ee-4d2c-b049-176dea3a2ff1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:24.594907 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-39412a3b-c8ee-4d2c-b049-176dea3a2ff1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1508 microversion: 2.1 time: 0.157848 Jul 21 22:42:24.595496 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 478/906] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:24 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:24.611920 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-961218c0-fb7a-4b4a-a60e-da26ee609aa1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "507f1299-77f1-43b7-b7cb-ba33f9ce18ef", "device": "/dev/sdb"}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:24.613522 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-961218c0-fb7a-4b4a-a60e-da26ee609aa1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:24.620171 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-961218c0-fb7a-4b4a-a60e-da26ee609aa1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:24.620624 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-961218c0-fb7a-4b4a-a60e-da26ee609aa1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:24.621413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-961218c0-fb7a-4b4a-a60e-da26ee609aa1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:24.621854 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-961218c0-fb7a-4b4a-a60e-da26ee609aa1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:24.859922 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-961218c0-fb7a-4b4a-a60e-da26ee609aa1 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "POST /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252514 Jul 21 22:42:24.860708 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 429/907] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jul 21 22:42:24 2022] POST /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:42.115598 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-c40fa7d1-5c5e-469c-9483-b441e8850021 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:42.116160 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-c40fa7d1-5c5e-469c-9483-b441e8850021 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:42.117942 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:42.118808 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=12 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:42.124440 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c40fa7d1-5c5e-469c-9483-b441e8850021 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:42.124935 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c40fa7d1-5c5e-469c-9483-b441e8850021 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:42.125915 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c40fa7d1-5c5e-469c-9483-b441e8850021 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:42.126349 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-c40fa7d1-5c5e-469c-9483-b441e8850021 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:42.214287 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.objects.instance [None req-c40fa7d1-5c5e-469c-9483-b441e8850021 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lazy-loading 'services' on Instance uuid 17d80be9-e737-44b4-b737-a7650b9efe5f {{(pid=124498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:42:42.288769 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-c40fa7d1-5c5e-469c-9483-b441e8850021 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f/os-volume_attachments/507f1299-77f1-43b7-b7cb-ba33f9ce18ef" status: 202 len: 0 microversion: 2.1 time: 0.177065 Jul 21 22:42:42.289359 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 479/908] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jul 21 22:42:42 2022] DELETE /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f/os-volume_attachments/507f1299-77f1-43b7-b7cb-ba33f9ce18ef => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:42:43.419751 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=44 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:43.420526 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:43.425582 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-905f02de-e7c4-4222-aa39-8c536537a57f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:43.426213 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-905f02de-e7c4-4222-aa39-8c536537a57f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:43.434149 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-905f02de-e7c4-4222-aa39-8c536537a57f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:43.434595 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-905f02de-e7c4-4222-aa39-8c536537a57f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:43.435426 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-905f02de-e7c4-4222-aa39-8c536537a57f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:43.435868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-905f02de-e7c4-4222-aa39-8c536537a57f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:43.465783 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-905f02de-e7c4-4222-aa39-8c536537a57f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:42:43.552532 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-905f02de-e7c4-4222-aa39-8c536537a57f tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "DELETE /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 204 len: 0 microversion: 2.1 time: 0.134147 Jul 21 22:42:43.553509 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 430/909] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:42:43 2022] DELETE /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:42:43.565327 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a846017e-7282-4fb4-8be5-2a5514ab1857 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:43.566015 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a846017e-7282-4fb4-8be5-2a5514ab1857 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:43.572334 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a846017e-7282-4fb4-8be5-2a5514ab1857 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:43.572778 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a846017e-7282-4fb4-8be5-2a5514ab1857 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:43.573531 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a846017e-7282-4fb4-8be5-2a5514ab1857 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:43.573957 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a846017e-7282-4fb4-8be5-2a5514ab1857 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:43.721988 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a846017e-7282-4fb4-8be5-2a5514ab1857 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:43.729728 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a846017e-7282-4fb4-8be5-2a5514ab1857 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1514 microversion: 2.1 time: 0.169419 Jul 21 22:42:43.730319 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 480/910] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:43 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:44.748488 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d05a4c9a-5b4d-4248-bcc7-16ae6f6782a0 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:44.749188 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d05a4c9a-5b4d-4248-bcc7-16ae6f6782a0 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:44.756315 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d05a4c9a-5b4d-4248-bcc7-16ae6f6782a0 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:44.756766 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d05a4c9a-5b4d-4248-bcc7-16ae6f6782a0 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:44.757537 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d05a4c9a-5b4d-4248-bcc7-16ae6f6782a0 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:44.757977 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d05a4c9a-5b4d-4248-bcc7-16ae6f6782a0 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:44.897540 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d05a4c9a-5b4d-4248-bcc7-16ae6f6782a0 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:44.907250 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d05a4c9a-5b4d-4248-bcc7-16ae6f6782a0 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1514 microversion: 2.1 time: 0.162303 Jul 21 22:42:44.907845 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 431/911] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:44 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:45.722715 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-a1c34b8c-9a6c-4e47-974c-a2e94a8d58d3 req-e17bd915-013f-4c88-904a-4a6277437967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d80be9-e737-44b4-b737-a7650b9efe5f", "name": "network-vif-deleted", "tag": "d5951f7e-7c96-4145-940b-1b5825dce885"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:45.731575 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-a1c34b8c-9a6c-4e47-974c-a2e94a8d58d3 req-e17bd915-013f-4c88-904a-4a6277437967 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:45.732091 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-a1c34b8c-9a6c-4e47-974c-a2e94a8d58d3 req-e17bd915-013f-4c88-904a-4a6277437967 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:45.743913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-a1c34b8c-9a6c-4e47-974c-a2e94a8d58d3 req-e17bd915-013f-4c88-904a-4a6277437967 service nova] Creating event network-vif-deleted:d5951f7e-7c96-4145-940b-1b5825dce885 for instance 17d80be9-e737-44b4-b737-a7650b9efe5f on hv-cinder-85069 Jul 21 22:42:45.750645 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-a1c34b8c-9a6c-4e47-974c-a2e94a8d58d3 req-e17bd915-013f-4c88-904a-4a6277437967 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 Jul 21 22:42:45.751318 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 481/912] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:45.925012 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-99cefd07-06b4-4209-a9bd-83dec19a304c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:45.925580 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-99cefd07-06b4-4209-a9bd-83dec19a304c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:45.931926 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-99cefd07-06b4-4209-a9bd-83dec19a304c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:45.932368 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-99cefd07-06b4-4209-a9bd-83dec19a304c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:45.933125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-99cefd07-06b4-4209-a9bd-83dec19a304c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:45.933555 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-99cefd07-06b4-4209-a9bd-83dec19a304c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:45.963360 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-99cefd07-06b4-4209-a9bd-83dec19a304c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:45.963882 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-99cefd07-06b4-4209-a9bd-83dec19a304c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:45.964297 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-99cefd07-06b4-4209-a9bd-83dec19a304c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lazy-loading 'fault' on Instance uuid 17d80be9-e737-44b4-b737-a7650b9efe5f {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:42:46.006773 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-99cefd07-06b4-4209-a9bd-83dec19a304c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36dcb01083d64210a3ddf86e0bda4287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c3434a76c647f99f50778ec26ffd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:46.014662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-99cefd07-06b4-4209-a9bd-83dec19a304c tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 200 len: 1309 microversion: 2.1 time: 0.094226 Jul 21 22:42:46.015274 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 432/913] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:45 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:47.034161 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-50cd8885-906b-4ffc-99a4-d566474ee032 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:47.034750 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-50cd8885-906b-4ffc-99a4-d566474ee032 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] [instance: 17d80be9-e737-44b4-b737-a7650b9efe5f] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:47.041826 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50cd8885-906b-4ffc-99a4-d566474ee032 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:47.042265 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50cd8885-906b-4ffc-99a4-d566474ee032 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:47.043030 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50cd8885-906b-4ffc-99a4-d566474ee032 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:47.043489 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-50cd8885-906b-4ffc-99a4-d566474ee032 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:47.059989 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-50cd8885-906b-4ffc-99a4-d566474ee032 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] HTTP exception thrown: Instance 17d80be9-e737-44b4-b737-a7650b9efe5f could not be found. Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-50cd8885-906b-4ffc-99a4-d566474ee032 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Request method failure captured: Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f HTTP/1.1 Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dYDaRUW_D6eMWxNJGoCJIXLV2aQf4T0qx-Uu0GW02jVG5q2NHJ1ewKlmX3ANBbDLLDg1nt3m5rg8-avUcN8Gqtchr5Np7rQYtZeQ_8054Mj3bGQrRIc2FrVCqvOGnYnXYT78BSBe58jXo_6jlpD0TpiQP81ngkrgvmFYPK9FKkNsWk Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: 69c3434a76c647f99f50778ec26ffd70 Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1992434964 Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:42:47.061756 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69c3434a76c647f99f50778ec26ffd70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69c3434a76c647f99f50778ec26ffd70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69c3434a76c647f99f50778ec26ffd70", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69c3434a76c647f99f50778ec26ffd70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-VolumesSnapshotTestJSON-1992434964 Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: 69c3434a76c647f99f50778ec26ffd70 Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1992434964 Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-VolumesSnapshotTestJSON-1992434964-project Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: 36dcb01083d64210a3ddf86e0bda4287 Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-VolumesSnapshotTestJSON-1992434964-project Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 17d80be9-e737-44b4-b737-a7650b9efe5f could not be found. Jul 21 22:42:47.064533 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '17d80be9-e737-44b4-b737-a7650b9efe5f'} Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d80be9-e737-44b4-b737-a7650b9efe5f could not be found. Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:42:47.065880 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d80be9-e737-44b4-b737-a7650b9efe5f could not be found. Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d80be9-e737-44b4-b737-a7650b9efe5f could not be found. Jul 21 22:42:47.068332 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:42:47.070768 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-50cd8885-906b-4ffc-99a4-d566474ee032 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] Returning 404 to user: Instance 17d80be9-e737-44b4-b737-a7650b9efe5f could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:42:47.070768 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-50cd8885-906b-4ffc-99a4-d566474ee032 tempest-VolumesSnapshotTestJSON-1992434964 tempest-VolumesSnapshotTestJSON-1992434964-project] 10.222.0.58 "GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f" status: 404 len: 111 microversion: 2.1 time: 0.034371 Jul 21 22:42:47.070768 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 482/914] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:47 2022] GET /compute/v2.1/servers/17d80be9-e737-44b4-b737-a7650b9efe5f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:43:37.115883 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:37.117343 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:37.335989 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9b5914c1-07b2-415f-bc68-eaa1f448cdfd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Action: 'create', calling method: .version_select at 0x7f47e6709550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1033363760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhWNok0LGdXIyUH3sfRu+zVt6QsOkB6z3xJiAgy8r6YzTf8qIZ+BopoW9n5smZ2sQqSRqUPgoBwz7/NMAP/itCyo6dM4WottsAA3NoZLWzosI/DxpDaFy0oHVfzQGkk2w=="}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:43:37.351146 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-9b5914c1-07b2-415f-bc68-eaa1f448cdfd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Getting quotas for project 8323020521c94131b7d9bef5aa456a70. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:43:37.358028 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-9b5914c1-07b2-415f-bc68-eaa1f448cdfd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Getting quotas for user 84f06063489847e68831b2c94fac2a26 and project 8323020521c94131b7d9bef5aa456a70. Resources: {'key_pairs'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:43:37.394950 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-9b5914c1-07b2-415f-bc68-eaa1f448cdfd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.284688 Jul 21 22:43:37.401118 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 433/915] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jul 21 22:43:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:52.822249 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=8 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:52.823096 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:52.827263 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-214198499", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1033363760", "security_groups": [{"name": "tempest-secgroup-smoke-135272220"}], "networks": [{"uuid": "e1d83e50-fb39-48b5-9d9a-3ed17577c624"}], "block_device_mapping_v2": [{"uuid": "da40fcea-b295-4565-b201-7f6a46dc209c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:43:53.046798 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.network.neutron [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] validate_networks() for [('e1d83e50-fb39-48b5-9d9a-3ed17577c624', None, None, None, None, None)] {{(pid=124498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:43:53.438348 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Flavor limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:43:53.438768 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Image limits 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:43:53.441230 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Flavor pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:43:53.441230 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Image pref 0:0:0 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:43:53.441230 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.virt.hardware [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:43:53.450362 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:53.450810 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:53.451638 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:53.452076 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:53.470190 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Getting quotas for project 8323020521c94131b7d9bef5aa456a70. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:43:53.474094 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.quota [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Getting quotas for user 84f06063489847e68831b2c94fac2a26 and project 8323020521c94131b7d9bef5aa456a70. Resources: {'instances', 'cores', 'ram'} {{(pid=124498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:43:53.531875 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Going to run 1 instances... {{(pid=124498) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:43:53.533965 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da40fcea-b295-4565-b201-7f6a46dc209c',volume_size=None,volume_type=None)] {{(pid=124498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:43:53.663148 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3b60aac8-46b0-4304-9c4b-e77d8f414473 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.841506 Jul 21 22:43:53.663412 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 483/916] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:43:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:43:53.674426 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=4 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:53.675514 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:53.683384 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9e60c232-3d63-4e49-80b9-3bf1e8763e0b tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:53.684948 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-9e60c232-3d63-4e49-80b9-3bf1e8763e0b tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:53.853809 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-9e60c232-3d63-4e49-80b9-3bf1e8763e0b tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:53.861016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-9e60c232-3d63-4e49-80b9-3bf1e8763e0b tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1088 microversion: 2.1 time: 0.189039 Jul 21 22:43:53.861715 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 434/917] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:53 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1088 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:54.878125 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-84cb5e8d-f67f-446a-8e7e-24f69272a7aa tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:54.879373 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-84cb5e8d-f67f-446a-8e7e-24f69272a7aa tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:54.888190 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-84cb5e8d-f67f-446a-8e7e-24f69272a7aa tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:54.888652 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-84cb5e8d-f67f-446a-8e7e-24f69272a7aa tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:54.889438 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-84cb5e8d-f67f-446a-8e7e-24f69272a7aa tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:54.889874 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-84cb5e8d-f67f-446a-8e7e-24f69272a7aa tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:54.952331 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-84cb5e8d-f67f-446a-8e7e-24f69272a7aa tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:54.960660 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-84cb5e8d-f67f-446a-8e7e-24f69272a7aa tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1204 microversion: 2.1 time: 0.086594 Jul 21 22:43:54.961433 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 484/918] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:54 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1204 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:55.979816 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-58434671-d1f2-4813-bd3e-e2b607cdadd5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:55.980436 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-58434671-d1f2-4813-bd3e-e2b607cdadd5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:55.988577 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-58434671-d1f2-4813-bd3e-e2b607cdadd5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:55.989066 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-58434671-d1f2-4813-bd3e-e2b607cdadd5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:55.990384 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-58434671-d1f2-4813-bd3e-e2b607cdadd5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:55.991265 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-58434671-d1f2-4813-bd3e-e2b607cdadd5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:56.132714 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-58434671-d1f2-4813-bd3e-e2b607cdadd5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:56.141076 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-58434671-d1f2-4813-bd3e-e2b607cdadd5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1259 microversion: 2.1 time: 0.166992 Jul 21 22:43:56.141668 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 435/919] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:55 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:56.557562 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-59de17b2-3ad7-4356-9fe6-d3aebe7ba440 req-f7040356-cb6d-4ecc-a609-b71e671f532e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d84fc6-e89a-4c35-ad6a-924c70acb1f0", "tag": "bd5d91b1-4dba-4a6d-b88e-220beafc270e"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:43:56.566641 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-59de17b2-3ad7-4356-9fe6-d3aebe7ba440 req-f7040356-cb6d-4ecc-a609-b71e671f532e service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:56.567114 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-59de17b2-3ad7-4356-9fe6-d3aebe7ba440 req-f7040356-cb6d-4ecc-a609-b71e671f532e service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:56.579569 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-59de17b2-3ad7-4356-9fe6-d3aebe7ba440 req-f7040356-cb6d-4ecc-a609-b71e671f532e service nova] Creating event network-changed:bd5d91b1-4dba-4a6d-b88e-220beafc270e for instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 on hv-cinder-85069 Jul 21 22:43:56.584670 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-59de17b2-3ad7-4356-9fe6-d3aebe7ba440 req-f7040356-cb6d-4ecc-a609-b71e671f532e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121855 Jul 21 22:43:56.585356 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 485/920] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:57.159513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-bdd5e7f4-9772-46e7-82d5-ef280c2d7718 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:57.160757 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-bdd5e7f4-9772-46e7-82d5-ef280c2d7718 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:57.167508 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-bdd5e7f4-9772-46e7-82d5-ef280c2d7718 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:57.167956 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-bdd5e7f4-9772-46e7-82d5-ef280c2d7718 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:57.168709 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-bdd5e7f4-9772-46e7-82d5-ef280c2d7718 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:57.169140 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-bdd5e7f4-9772-46e7-82d5-ef280c2d7718 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:57.306801 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-bdd5e7f4-9772-46e7-82d5-ef280c2d7718 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:57.314447 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-bdd5e7f4-9772-46e7-82d5-ef280c2d7718 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1259 microversion: 2.1 time: 0.158902 Jul 21 22:43:57.315147 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 436/921] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:57 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:58.333157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6c6dd62a-792a-41de-a1a9-d9b62859db63 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:58.334636 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6c6dd62a-792a-41de-a1a9-d9b62859db63 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:58.340933 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c6dd62a-792a-41de-a1a9-d9b62859db63 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:58.341375 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c6dd62a-792a-41de-a1a9-d9b62859db63 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:58.342132 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c6dd62a-792a-41de-a1a9-d9b62859db63 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:58.342565 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6c6dd62a-792a-41de-a1a9-d9b62859db63 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:58.478919 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6c6dd62a-792a-41de-a1a9-d9b62859db63 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:58.486387 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6c6dd62a-792a-41de-a1a9-d9b62859db63 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1259 microversion: 2.1 time: 0.157855 Jul 21 22:43:58.486949 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 486/922] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:58 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:59.503441 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1ae0ecc6-c74d-4172-b427-6a9e8268fde0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:59.504123 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1ae0ecc6-c74d-4172-b427-6a9e8268fde0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:59.511409 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ae0ecc6-c74d-4172-b427-6a9e8268fde0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:59.511861 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ae0ecc6-c74d-4172-b427-6a9e8268fde0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:59.512631 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ae0ecc6-c74d-4172-b427-6a9e8268fde0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:59.513351 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1ae0ecc6-c74d-4172-b427-6a9e8268fde0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:59.650474 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1ae0ecc6-c74d-4172-b427-6a9e8268fde0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:59.658311 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1ae0ecc6-c74d-4172-b427-6a9e8268fde0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1259 microversion: 2.1 time: 0.158939 Jul 21 22:43:59.658899 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 437/923] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:59 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:00.676865 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-29d11762-5826-42f4-8020-b0a5e7bda20e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:00.677606 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-29d11762-5826-42f4-8020-b0a5e7bda20e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:00.684061 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29d11762-5826-42f4-8020-b0a5e7bda20e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:00.684503 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29d11762-5826-42f4-8020-b0a5e7bda20e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:00.685254 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29d11762-5826-42f4-8020-b0a5e7bda20e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:00.685685 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-29d11762-5826-42f4-8020-b0a5e7bda20e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:00.816557 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-29d11762-5826-42f4-8020-b0a5e7bda20e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:00.824882 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-29d11762-5826-42f4-8020-b0a5e7bda20e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1259 microversion: 2.1 time: 0.151882 Jul 21 22:44:00.825821 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 487/924] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:00 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:01.842619 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3f82e98c-3e00-4731-92d7-346368de4edd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:01.843240 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3f82e98c-3e00-4731-92d7-346368de4edd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:01.850543 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3f82e98c-3e00-4731-92d7-346368de4edd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:01.850996 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3f82e98c-3e00-4731-92d7-346368de4edd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:01.851786 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3f82e98c-3e00-4731-92d7-346368de4edd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:01.852223 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3f82e98c-3e00-4731-92d7-346368de4edd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:01.987705 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3f82e98c-3e00-4731-92d7-346368de4edd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:01.995885 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3f82e98c-3e00-4731-92d7-346368de4edd tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1259 microversion: 2.1 time: 0.157284 Jul 21 22:44:01.996455 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 438/925] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:01 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:03.012645 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f4ab7511-dcdc-45d2-80da-cc90b38b4028 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:03.013464 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f4ab7511-dcdc-45d2-80da-cc90b38b4028 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:03.020016 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f4ab7511-dcdc-45d2-80da-cc90b38b4028 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:03.020469 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f4ab7511-dcdc-45d2-80da-cc90b38b4028 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:03.021249 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f4ab7511-dcdc-45d2-80da-cc90b38b4028 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:03.021682 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f4ab7511-dcdc-45d2-80da-cc90b38b4028 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:03.157691 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f4ab7511-dcdc-45d2-80da-cc90b38b4028 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:03.165804 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f4ab7511-dcdc-45d2-80da-cc90b38b4028 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1259 microversion: 2.1 time: 0.157138 Jul 21 22:44:03.166367 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 488/926] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:03 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:04.182390 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b5b7b526-3f21-4e27-923c-715fc2457397 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:04.183002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b5b7b526-3f21-4e27-923c-715fc2457397 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:04.185382 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:04.190887 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5b7b526-3f21-4e27-923c-715fc2457397 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:04.191362 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5b7b526-3f21-4e27-923c-715fc2457397 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:04.192138 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5b7b526-3f21-4e27-923c-715fc2457397 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:04.192581 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5b7b526-3f21-4e27-923c-715fc2457397 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:04.333248 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b5b7b526-3f21-4e27-923c-715fc2457397 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:04.341043 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b5b7b526-3f21-4e27-923c-715fc2457397 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1259 microversion: 2.1 time: 0.162610 Jul 21 22:44:04.341532 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 439/927] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:04 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:05.359257 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b4b728ef-c705-44e7-8cb7-45a8a5d41692 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:05.359864 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b4b728ef-c705-44e7-8cb7-45a8a5d41692 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:05.361879 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:05.362730 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=6 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:05.369459 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4b728ef-c705-44e7-8cb7-45a8a5d41692 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:05.369913 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4b728ef-c705-44e7-8cb7-45a8a5d41692 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:05.370724 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4b728ef-c705-44e7-8cb7-45a8a5d41692 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:05.371202 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b4b728ef-c705-44e7-8cb7-45a8a5d41692 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:05.504357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b4b728ef-c705-44e7-8cb7-45a8a5d41692 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:05.512665 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b4b728ef-c705-44e7-8cb7-45a8a5d41692 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1259 microversion: 2.1 time: 0.157471 Jul 21 22:44:05.513486 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 489/928] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:05 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:06.529880 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-fa8a5a9c-258f-4acb-b8c5-fdb42c25d6bc tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:06.530501 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-fa8a5a9c-258f-4acb-b8c5-fdb42c25d6bc tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:06.537630 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fa8a5a9c-258f-4acb-b8c5-fdb42c25d6bc tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:06.538077 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fa8a5a9c-258f-4acb-b8c5-fdb42c25d6bc tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:06.538846 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fa8a5a9c-258f-4acb-b8c5-fdb42c25d6bc tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:06.539310 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-fa8a5a9c-258f-4acb-b8c5-fdb42c25d6bc tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:06.674207 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-fa8a5a9c-258f-4acb-b8c5-fdb42c25d6bc tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:06.681942 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-fa8a5a9c-258f-4acb-b8c5-fdb42c25d6bc tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1259 microversion: 2.1 time: 0.155997 Jul 21 22:44:06.682513 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 440/929] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:06 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:07.047129 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-bb719f35-ea38-47ea-a10f-f4a870c83937 req-9048243e-8d69-4aab-a981-f6a923bf437f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d84fc6-e89a-4c35-ad6a-924c70acb1f0", "name": "network-vif-plugged", "status": "completed", "tag": "bd5d91b1-4dba-4a6d-b88e-220beafc270e"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:07.056339 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-bb719f35-ea38-47ea-a10f-f4a870c83937 req-9048243e-8d69-4aab-a981-f6a923bf437f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:07.056900 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-bb719f35-ea38-47ea-a10f-f4a870c83937 req-9048243e-8d69-4aab-a981-f6a923bf437f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:07.069313 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-bb719f35-ea38-47ea-a10f-f4a870c83937 req-9048243e-8d69-4aab-a981-f6a923bf437f service nova] Creating event network-vif-plugged:bd5d91b1-4dba-4a6d-b88e-220beafc270e for instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 on hv-cinder-85069 Jul 21 22:44:07.074312 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-bb719f35-ea38-47ea-a10f-f4a870c83937 req-9048243e-8d69-4aab-a981-f6a923bf437f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088554 Jul 21 22:44:07.074905 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 490/930] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:07.698676 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-05aecd71-259b-4521-8be5-837d80f93c02 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:07.699693 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-05aecd71-259b-4521-8be5-837d80f93c02 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:07.706580 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05aecd71-259b-4521-8be5-837d80f93c02 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:07.707020 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05aecd71-259b-4521-8be5-837d80f93c02 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:07.707819 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05aecd71-259b-4521-8be5-837d80f93c02 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:07.708250 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-05aecd71-259b-4521-8be5-837d80f93c02 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:07.848864 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-05aecd71-259b-4521-8be5-837d80f93c02 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:07.857061 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-05aecd71-259b-4521-8be5-837d80f93c02 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1259 microversion: 2.1 time: 0.162690 Jul 21 22:44:07.857625 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 441/931] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:07 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:08.875452 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6ac46024-889e-408f-9feb-c78630458859 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:08.876179 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6ac46024-889e-408f-9feb-c78630458859 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:08.882487 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ac46024-889e-408f-9feb-c78630458859 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:08.882932 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ac46024-889e-408f-9feb-c78630458859 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:08.883738 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ac46024-889e-408f-9feb-c78630458859 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:08.884173 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6ac46024-889e-408f-9feb-c78630458859 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:09.016738 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6ac46024-889e-408f-9feb-c78630458859 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:09.024449 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6ac46024-889e-408f-9feb-c78630458859 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1443 microversion: 2.1 time: 0.153778 Jul 21 22:44:09.025038 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 491/932] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:08 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:09.040403 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-ac036dcb-70da-4f69-ab98-b495fcbec90d tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:09.041049 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-ac036dcb-70da-4f69-ab98-b495fcbec90d tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:09.047896 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ac036dcb-70da-4f69-ab98-b495fcbec90d tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:09.048338 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ac036dcb-70da-4f69-ab98-b495fcbec90d tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:09.049097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ac036dcb-70da-4f69-ab98-b495fcbec90d tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:09.049533 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ac036dcb-70da-4f69-ab98-b495fcbec90d tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:09.192323 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-ac036dcb-70da-4f69-ab98-b495fcbec90d tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:09.196944 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-ac036dcb-70da-4f69-ab98-b495fcbec90d tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1443 microversion: 2.1 time: 0.160384 Jul 21 22:44:09.197753 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 442/933] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:09 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:10.907998 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-94023946-7aa1-437d-b29c-253a44f5f5dd req-58eed70b-0cb7-48e1-9d73-d5691ee1b78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d84fc6-e89a-4c35-ad6a-924c70acb1f0", "tag": "bd5d91b1-4dba-4a6d-b88e-220beafc270e"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:10.920980 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-94023946-7aa1-437d-b29c-253a44f5f5dd req-58eed70b-0cb7-48e1-9d73-d5691ee1b78e service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:10.920980 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-94023946-7aa1-437d-b29c-253a44f5f5dd req-58eed70b-0cb7-48e1-9d73-d5691ee1b78e service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:10.931446 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-94023946-7aa1-437d-b29c-253a44f5f5dd req-58eed70b-0cb7-48e1-9d73-d5691ee1b78e service nova] Creating event network-changed:bd5d91b1-4dba-4a6d-b88e-220beafc270e for instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 on hv-cinder-85069 Jul 21 22:44:10.937547 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-94023946-7aa1-437d-b29c-253a44f5f5dd req-58eed70b-0cb7-48e1-9d73-d5691ee1b78e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033473 Jul 21 22:44:10.938387 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 492/934] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:16.154577 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-627c6f35-e18b-4a9b-809e-99562ad1f18f tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:16.155203 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-627c6f35-e18b-4a9b-809e-99562ad1f18f tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:16.161921 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-627c6f35-e18b-4a9b-809e-99562ad1f18f tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:16.162374 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-627c6f35-e18b-4a9b-809e-99562ad1f18f tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:16.163185 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-627c6f35-e18b-4a9b-809e-99562ad1f18f tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:16.163630 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-627c6f35-e18b-4a9b-809e-99562ad1f18f tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:16.189897 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-627c6f35-e18b-4a9b-809e-99562ad1f18f tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:44:16.273300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-627c6f35-e18b-4a9b-809e-99562ad1f18f tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 204 len: 0 microversion: 2.1 time: 0.123281 Jul 21 22:44:16.273940 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 443/935] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:44:16 2022] DELETE /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:44:16.282968 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7260959b-e210-49d0-965a-4fe29a3f70c1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:16.284097 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7260959b-e210-49d0-965a-4fe29a3f70c1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:16.290931 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7260959b-e210-49d0-965a-4fe29a3f70c1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:16.291411 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7260959b-e210-49d0-965a-4fe29a3f70c1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:16.292213 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7260959b-e210-49d0-965a-4fe29a3f70c1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:16.292950 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7260959b-e210-49d0-965a-4fe29a3f70c1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:16.429497 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7260959b-e210-49d0-965a-4fe29a3f70c1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:16.437823 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7260959b-e210-49d0-965a-4fe29a3f70c1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1576 microversion: 2.1 time: 0.158984 Jul 21 22:44:16.438400 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 493/936] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:16 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:17.455300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-2c91d0e0-3afe-44a5-a801-93e152c91028 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:17.456030 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-2c91d0e0-3afe-44a5-a801-93e152c91028 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:17.462583 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2c91d0e0-3afe-44a5-a801-93e152c91028 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:17.463033 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2c91d0e0-3afe-44a5-a801-93e152c91028 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:17.464051 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2c91d0e0-3afe-44a5-a801-93e152c91028 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:17.464610 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-2c91d0e0-3afe-44a5-a801-93e152c91028 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:17.598762 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-2c91d0e0-3afe-44a5-a801-93e152c91028 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:17.607236 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-2c91d0e0-3afe-44a5-a801-93e152c91028 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1576 microversion: 2.1 time: 0.156326 Jul 21 22:44:17.607816 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 444/937] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:17 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:18.592062 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-f64c331f-bd4d-4c01-bfeb-19b239dafda5 req-1bed172f-c41e-48ec-86c9-c33e2c56834e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a280f0d7-0ea3-4377-898d-14c4b0d8a929", "name": "network-vif-deleted", "tag": "0688abfa-d32e-4d9a-9493-aa5974aaa63f"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:18.601967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-f64c331f-bd4d-4c01-bfeb-19b239dafda5 req-1bed172f-c41e-48ec-86c9-c33e2c56834e service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:18.602426 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-f64c331f-bd4d-4c01-bfeb-19b239dafda5 req-1bed172f-c41e-48ec-86c9-c33e2c56834e service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:18.617043 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-f64c331f-bd4d-4c01-bfeb-19b239dafda5 req-1bed172f-c41e-48ec-86c9-c33e2c56834e service nova] Creating event network-vif-deleted:0688abfa-d32e-4d9a-9493-aa5974aaa63f for instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 on hv-cinder-85069 Jul 21 22:44:18.624894 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-27d3e021-a9ac-4aa7-8d19-9fdc44719bdd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:18.625495 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-27d3e021-a9ac-4aa7-8d19-9fdc44719bdd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:18.632998 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-f64c331f-bd4d-4c01-bfeb-19b239dafda5 req-1bed172f-c41e-48ec-86c9-c33e2c56834e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045347 Jul 21 22:44:18.633601 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 494/938] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:18.641208 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-27d3e021-a9ac-4aa7-8d19-9fdc44719bdd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:18.642581 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-27d3e021-a9ac-4aa7-8d19-9fdc44719bdd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:18.644108 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-27d3e021-a9ac-4aa7-8d19-9fdc44719bdd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:18.644727 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-27d3e021-a9ac-4aa7-8d19-9fdc44719bdd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:18.728330 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-27d3e021-a9ac-4aa7-8d19-9fdc44719bdd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:18.737167 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-27d3e021-a9ac-4aa7-8d19-9fdc44719bdd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 200 len: 1224 microversion: 2.1 time: 0.117177 Jul 21 22:44:18.737797 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 445/939] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:18 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:19.756177 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-11638c5d-1096-4218-8e52-a017d06a366b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:19.756801 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-11638c5d-1096-4218-8e52-a017d06a366b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:19.763952 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-11638c5d-1096-4218-8e52-a017d06a366b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:19.764403 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-11638c5d-1096-4218-8e52-a017d06a366b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:19.765165 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-11638c5d-1096-4218-8e52-a017d06a366b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:19.765600 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-11638c5d-1096-4218-8e52-a017d06a366b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:19.779180 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-11638c5d-1096-4218-8e52-a017d06a366b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] HTTP exception thrown: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-11638c5d-1096-4218-8e52-a017d06a366b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Request method failure captured: Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 HTTP/1.1 Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dYbepniAuzydudqj9jHfd7hasx6r9Z3U-8l004a4-wK6Um_4WxYWFbgk8Te9BObBrOt0qWt2Tx5OQQpYeB0uNfsw_uv8kTWWNl_ozGedGRLvrG2V6Z_OeVgqtxPsnIfLKkFltKzmwfWauo-CMH8vo1AebQte2yt0UU6pbeI8Woup_o Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: e61e273f945e45f0a6e1f3b45e4bc9d2 Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:44:19.780794 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e61e273f945e45f0a6e1f3b45e4bc9d2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: e61e273f945e45f0a6e1f3b45e4bc9d2 Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-TestVolumeBootPattern-1281267028-project Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: a367906e74654507aaed8b885d525a0f Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-TestVolumeBootPattern-1281267028-project Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:44:19.782524 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'a280f0d7-0ea3-4377-898d-14c4b0d8a929'} Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:44:19.783586 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:44:19.785214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:44:19.786673 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-11638c5d-1096-4218-8e52-a017d06a366b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Returning 404 to user: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:44:19.786673 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-11638c5d-1096-4218-8e52-a017d06a366b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 404 len: 111 microversion: 2.1 time: 0.030885 Jul 21 22:44:19.786673 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 495/940] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:19 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:44:19.882861 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-13019491", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-67081037", "security_groups": [{"name": "tempest-secgroup-smoke-1368037390"}], "block_device_mapping_v2": [{"uuid": "27e18aa7-f981-4cd6-ba4a-1f98f531b494", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "60f1b2e3-fd49-40e5-9c63-36eb47bcf006"}]}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:19.995187 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] validate_networks() for [('60f1b2e3-fd49-40e5-9c63-36eb47bcf006', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:44:20.429864 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:44:20.430290 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:44:20.430781 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:44:20.431293 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:44:20.431711 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:44:20.441564 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:20.442021 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:20.442868 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:20.443336 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:20.461044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Getting quotas for project e61e273f945e45f0a6e1f3b45e4bc9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:44:20.465990 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Getting quotas for user a367906e74654507aaed8b885d525a0f and project e61e273f945e45f0a6e1f3b45e4bc9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:44:20.524685 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:44:20.526959 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='27e18aa7-f981-4cd6-ba4a-1f98f531b494',volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:44:20.675144 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a94262f4-bee3-49bc-91f3-8c4ae0c51bc5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.796121 Jul 21 22:44:20.675799 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 446/941] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:44:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 22:44:20.686175 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-083ff8ca-11bc-467e-ae6e-646471f28ff7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:20.686897 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-083ff8ca-11bc-467e-ae6e-646471f28ff7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:20.746978 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-083ff8ca-11bc-467e-ae6e-646471f28ff7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:20.751709 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-083ff8ca-11bc-467e-ae6e-646471f28ff7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1091 microversion: 2.1 time: 0.069558 Jul 21 22:44:20.752205 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 496/942] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:20 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1091 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:21.769272 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d84c0565-f401-4713-8632-11f7dc2e0dfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:21.769946 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d84c0565-f401-4713-8632-11f7dc2e0dfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:21.776690 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d84c0565-f401-4713-8632-11f7dc2e0dfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.777750 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d84c0565-f401-4713-8632-11f7dc2e0dfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.778492 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d84c0565-f401-4713-8632-11f7dc2e0dfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.778911 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d84c0565-f401-4713-8632-11f7dc2e0dfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.847483 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d84c0565-f401-4713-8632-11f7dc2e0dfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:21.855399 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d84c0565-f401-4713-8632-11f7dc2e0dfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1207 microversion: 2.1 time: 0.090533 Jul 21 22:44:21.856020 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 447/943] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:21 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1207 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:22.874460 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8032dfce-c3fe-462d-9890-9d6935b73618 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:22.875090 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8032dfce-c3fe-462d-9890-9d6935b73618 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:22.877650 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:22.884171 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8032dfce-c3fe-462d-9890-9d6935b73618 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:22.884628 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8032dfce-c3fe-462d-9890-9d6935b73618 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:22.885417 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8032dfce-c3fe-462d-9890-9d6935b73618 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:22.885852 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8032dfce-c3fe-462d-9890-9d6935b73618 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:22.892771 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=55 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:23.045143 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8032dfce-c3fe-462d-9890-9d6935b73618 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:23.052967 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8032dfce-c3fe-462d-9890-9d6935b73618 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1263 microversion: 2.1 time: 0.182998 Jul 21 22:44:23.053550 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 497/944] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:22 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1263 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:23.244421 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-1b07f57c-7075-4503-9b47-4a34e1f7d9db req-09324b9b-606f-4ebf-9793-7029a3f3f7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ebf093-5ed7-4841-ada9-56fb64c01d36", "tag": "204879ec-a2ca-4355-9c8e-0ef34248f73b"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:23.258869 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-1b07f57c-7075-4503-9b47-4a34e1f7d9db req-09324b9b-606f-4ebf-9793-7029a3f3f7ee service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:23.259347 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-1b07f57c-7075-4503-9b47-4a34e1f7d9db req-09324b9b-606f-4ebf-9793-7029a3f3f7ee service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:23.273212 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-1b07f57c-7075-4503-9b47-4a34e1f7d9db req-09324b9b-606f-4ebf-9793-7029a3f3f7ee service nova] Creating event network-changed:204879ec-a2ca-4355-9c8e-0ef34248f73b for instance 31ebf093-5ed7-4841-ada9-56fb64c01d36 on hv-cinder-85069 Jul 21 22:44:23.278314 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-1b07f57c-7075-4503-9b47-4a34e1f7d9db req-09324b9b-606f-4ebf-9793-7029a3f3f7ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037530 Jul 21 22:44:23.279139 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 448/945] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:24.070363 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-fddfd62b-31cc-424b-946a-aa205f52c0d5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:24.070971 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-fddfd62b-31cc-424b-946a-aa205f52c0d5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:24.078564 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fddfd62b-31cc-424b-946a-aa205f52c0d5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:24.079016 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fddfd62b-31cc-424b-946a-aa205f52c0d5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:24.079837 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fddfd62b-31cc-424b-946a-aa205f52c0d5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:24.080274 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-fddfd62b-31cc-424b-946a-aa205f52c0d5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:24.218508 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-fddfd62b-31cc-424b-946a-aa205f52c0d5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:24.226021 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-fddfd62b-31cc-424b-946a-aa205f52c0d5 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1263 microversion: 2.1 time: 0.159509 Jul 21 22:44:24.226590 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 498/946] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:24 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:25.244725 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f41b61d5-7de9-4144-9b5b-f632f36f9327 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:25.245520 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f41b61d5-7de9-4144-9b5b-f632f36f9327 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:25.247492 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:25.252962 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f41b61d5-7de9-4144-9b5b-f632f36f9327 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:25.253837 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f41b61d5-7de9-4144-9b5b-f632f36f9327 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:25.255037 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f41b61d5-7de9-4144-9b5b-f632f36f9327 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:25.255508 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f41b61d5-7de9-4144-9b5b-f632f36f9327 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:25.259413 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:25.395486 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f41b61d5-7de9-4144-9b5b-f632f36f9327 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:25.403422 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f41b61d5-7de9-4144-9b5b-f632f36f9327 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1263 microversion: 2.1 time: 0.163368 Jul 21 22:44:25.404188 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 449/947] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:25 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:26.419982 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8cc9b1bf-84ad-4754-b1f9-5adf0b95d729 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:26.420641 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8cc9b1bf-84ad-4754-b1f9-5adf0b95d729 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:26.427734 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8cc9b1bf-84ad-4754-b1f9-5adf0b95d729 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:26.428200 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8cc9b1bf-84ad-4754-b1f9-5adf0b95d729 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:26.429023 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8cc9b1bf-84ad-4754-b1f9-5adf0b95d729 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:26.429468 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8cc9b1bf-84ad-4754-b1f9-5adf0b95d729 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:26.819496 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8cc9b1bf-84ad-4754-b1f9-5adf0b95d729 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:26.828168 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8cc9b1bf-84ad-4754-b1f9-5adf0b95d729 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1263 microversion: 2.1 time: 0.412679 Jul 21 22:44:26.828744 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 499/948] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:26 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1263 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:27.846487 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7a1b5de4-a0b7-46c2-b649-d48c3e5deaf3 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:27.847629 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7a1b5de4-a0b7-46c2-b649-d48c3e5deaf3 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:27.859117 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7a1b5de4-a0b7-46c2-b649-d48c3e5deaf3 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:27.859816 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7a1b5de4-a0b7-46c2-b649-d48c3e5deaf3 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:27.860637 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7a1b5de4-a0b7-46c2-b649-d48c3e5deaf3 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:27.861070 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7a1b5de4-a0b7-46c2-b649-d48c3e5deaf3 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:27.990729 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7a1b5de4-a0b7-46c2-b649-d48c3e5deaf3 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:27.999745 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7a1b5de4-a0b7-46c2-b649-d48c3e5deaf3 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1263 microversion: 2.1 time: 0.157788 Jul 21 22:44:28.000317 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 450/949] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:27 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:29.017804 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-3ea73ce9-7ede-4351-951f-969b589d66c7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:29.018369 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-3ea73ce9-7ede-4351-951f-969b589d66c7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:29.024896 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3ea73ce9-7ede-4351-951f-969b589d66c7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:29.025350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3ea73ce9-7ede-4351-951f-969b589d66c7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:29.026131 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3ea73ce9-7ede-4351-951f-969b589d66c7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:29.026571 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-3ea73ce9-7ede-4351-951f-969b589d66c7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:29.166206 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-3ea73ce9-7ede-4351-951f-969b589d66c7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:29.174565 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-3ea73ce9-7ede-4351-951f-969b589d66c7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1263 microversion: 2.1 time: 0.161511 Jul 21 22:44:29.175149 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 500/950] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:29 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:30.191367 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5472a8e8-3c8b-45a2-8558-e6d3db7a5f94 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:30.191949 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5472a8e8-3c8b-45a2-8558-e6d3db7a5f94 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:30.198361 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5472a8e8-3c8b-45a2-8558-e6d3db7a5f94 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:30.198807 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5472a8e8-3c8b-45a2-8558-e6d3db7a5f94 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:30.199621 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5472a8e8-3c8b-45a2-8558-e6d3db7a5f94 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:30.200019 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5472a8e8-3c8b-45a2-8558-e6d3db7a5f94 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:30.334155 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-5472a8e8-3c8b-45a2-8558-e6d3db7a5f94 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:30.341671 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-5472a8e8-3c8b-45a2-8558-e6d3db7a5f94 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1263 microversion: 2.1 time: 0.154320 Jul 21 22:44:30.342245 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 451/951] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:30 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:31.358281 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-2a7b7a2f-65f0-496a-b42b-a4ccac3e0a09 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:31.359470 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-2a7b7a2f-65f0-496a-b42b-a4ccac3e0a09 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:31.362432 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=2 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:31.369274 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2a7b7a2f-65f0-496a-b42b-a4ccac3e0a09 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:31.369753 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2a7b7a2f-65f0-496a-b42b-a4ccac3e0a09 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:31.370569 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2a7b7a2f-65f0-496a-b42b-a4ccac3e0a09 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:31.371018 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-2a7b7a2f-65f0-496a-b42b-a4ccac3e0a09 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:31.515928 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-2a7b7a2f-65f0-496a-b42b-a4ccac3e0a09 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:31.523375 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-2a7b7a2f-65f0-496a-b42b-a4ccac3e0a09 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1263 microversion: 2.1 time: 0.169278 Jul 21 22:44:31.523930 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 501/952] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:31 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:32.540788 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-5a100cfa-2670-4096-8e34-78635624ddde tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:32.541355 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-5a100cfa-2670-4096-8e34-78635624ddde tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:32.543175 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:32.543874 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=6 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:32.550357 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5a100cfa-2670-4096-8e34-78635624ddde tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:32.550809 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5a100cfa-2670-4096-8e34-78635624ddde tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:32.551641 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5a100cfa-2670-4096-8e34-78635624ddde tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:32.552081 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-5a100cfa-2670-4096-8e34-78635624ddde tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:32.684875 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-5a100cfa-2670-4096-8e34-78635624ddde tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:32.692468 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-5a100cfa-2670-4096-8e34-78635624ddde tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1263 microversion: 2.1 time: 0.155680 Jul 21 22:44:32.693044 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 452/953] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:32 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:33.091428 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-9b059c8d-4ad5-424e-84eb-f0e900a5bcc2 req-22071579-d34b-4d84-86d1-9382dac829f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ebf093-5ed7-4841-ada9-56fb64c01d36", "name": "network-vif-plugged", "status": "completed", "tag": "204879ec-a2ca-4355-9c8e-0ef34248f73b"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:33.100906 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-9b059c8d-4ad5-424e-84eb-f0e900a5bcc2 req-22071579-d34b-4d84-86d1-9382dac829f0 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:33.101359 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-9b059c8d-4ad5-424e-84eb-f0e900a5bcc2 req-22071579-d34b-4d84-86d1-9382dac829f0 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:33.113192 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-9b059c8d-4ad5-424e-84eb-f0e900a5bcc2 req-22071579-d34b-4d84-86d1-9382dac829f0 service nova] Creating event network-vif-plugged:204879ec-a2ca-4355-9c8e-0ef34248f73b for instance 31ebf093-5ed7-4841-ada9-56fb64c01d36 on hv-cinder-85069 Jul 21 22:44:33.118100 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-9b059c8d-4ad5-424e-84eb-f0e900a5bcc2 req-22071579-d34b-4d84-86d1-9382dac829f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030396 Jul 21 22:44:33.118905 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 502/954] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:33.709751 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-404f4ad3-71a5-4222-b354-109db1c4fbc2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:33.710359 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-404f4ad3-71a5-4222-b354-109db1c4fbc2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:33.717560 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-404f4ad3-71a5-4222-b354-109db1c4fbc2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:33.718009 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-404f4ad3-71a5-4222-b354-109db1c4fbc2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:33.718772 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-404f4ad3-71a5-4222-b354-109db1c4fbc2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:33.719242 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-404f4ad3-71a5-4222-b354-109db1c4fbc2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:33.850349 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-404f4ad3-71a5-4222-b354-109db1c4fbc2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:33.858401 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-404f4ad3-71a5-4222-b354-109db1c4fbc2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1263 microversion: 2.1 time: 0.152536 Jul 21 22:44:33.858969 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 453/955] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:33 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:34.876818 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a3b18db7-65b5-44b3-8d17-97f8a600455b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:34.877517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a3b18db7-65b5-44b3-8d17-97f8a600455b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:34.883680 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a3b18db7-65b5-44b3-8d17-97f8a600455b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:34.884151 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a3b18db7-65b5-44b3-8d17-97f8a600455b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:34.884914 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a3b18db7-65b5-44b3-8d17-97f8a600455b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:34.885349 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a3b18db7-65b5-44b3-8d17-97f8a600455b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:35.020006 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-a3b18db7-65b5-44b3-8d17-97f8a600455b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:35.028132 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a3b18db7-65b5-44b3-8d17-97f8a600455b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1449 microversion: 2.1 time: 0.156229 Jul 21 22:44:35.028746 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 503/956] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:34 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:35.044693 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7cd74d87-6e8e-47ec-b709-78bbe6fbf15e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:35.045791 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7cd74d87-6e8e-47ec-b709-78bbe6fbf15e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:35.051955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7cd74d87-6e8e-47ec-b709-78bbe6fbf15e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:35.052404 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7cd74d87-6e8e-47ec-b709-78bbe6fbf15e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:35.053185 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7cd74d87-6e8e-47ec-b709-78bbe6fbf15e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:35.053629 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7cd74d87-6e8e-47ec-b709-78bbe6fbf15e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:35.184395 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-7cd74d87-6e8e-47ec-b709-78bbe6fbf15e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:35.191968 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7cd74d87-6e8e-47ec-b709-78bbe6fbf15e tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1449 microversion: 2.1 time: 0.151751 Jul 21 22:44:35.192537 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 454/957] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:35 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:36.845049 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-66283a27-0b5b-4465-9383-267a5d13c5c0 req-89ce3dee-a734-4ec8-91ce-97611c7f3aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ebf093-5ed7-4841-ada9-56fb64c01d36", "tag": "204879ec-a2ca-4355-9c8e-0ef34248f73b"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:36.853451 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-66283a27-0b5b-4465-9383-267a5d13c5c0 req-89ce3dee-a734-4ec8-91ce-97611c7f3aba service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:36.853929 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-66283a27-0b5b-4465-9383-267a5d13c5c0 req-89ce3dee-a734-4ec8-91ce-97611c7f3aba service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:36.866039 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-66283a27-0b5b-4465-9383-267a5d13c5c0 req-89ce3dee-a734-4ec8-91ce-97611c7f3aba service nova] Creating event network-changed:204879ec-a2ca-4355-9c8e-0ef34248f73b for instance 31ebf093-5ed7-4841-ada9-56fb64c01d36 on hv-cinder-85069 Jul 21 22:44:36.870924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-66283a27-0b5b-4465-9383-267a5d13c5c0 req-89ce3dee-a734-4ec8-91ce-97611c7f3aba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030566 Jul 21 22:44:36.871568 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 504/958] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:48.046190 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:44:48.046786 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Thu Jul 21 22:44:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:46:03.007593 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=11 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:03.008283 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=35 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:03.013365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-806fe7cd-ed14-40cb-a6ac-46b96ee5f87e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:03.013898 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-806fe7cd-ed14-40cb-a6ac-46b96ee5f87e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:03.021138 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-806fe7cd-ed14-40cb-a6ac-46b96ee5f87e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:03.021585 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-806fe7cd-ed14-40cb-a6ac-46b96ee5f87e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:03.022356 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-806fe7cd-ed14-40cb-a6ac-46b96ee5f87e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:03.022801 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-806fe7cd-ed14-40cb-a6ac-46b96ee5f87e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:03.045114 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-806fe7cd-ed14-40cb-a6ac-46b96ee5f87e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lazy-loading 'flavor' on Instance uuid 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:46:03.116595 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-806fe7cd-ed14-40cb-a6ac-46b96ee5f87e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "POST /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0/action" status: 202 len: 0 microversion: 2.1 time: 0.110642 Jul 21 22:46:03.117190 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 455/959] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:46:03 2022] POST /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:46:03.123684 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=15 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:03.124427 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=39 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:03.129871 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0a395d6d-241c-46b0-b53f-ccb71109b69e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:03.130616 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0a395d6d-241c-46b0-b53f-ccb71109b69e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:03.138252 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0a395d6d-241c-46b0-b53f-ccb71109b69e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:03.138704 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0a395d6d-241c-46b0-b53f-ccb71109b69e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:03.139518 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0a395d6d-241c-46b0-b53f-ccb71109b69e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:03.139958 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0a395d6d-241c-46b0-b53f-ccb71109b69e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:03.273221 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-0a395d6d-241c-46b0-b53f-ccb71109b69e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:03.280817 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0a395d6d-241c-46b0-b53f-ccb71109b69e tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.159150 Jul 21 22:46:03.281379 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 505/960] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:03 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:04.299644 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-8d497a8b-595a-4905-8346-a6ede1326d3c tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:04.300288 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-8d497a8b-595a-4905-8346-a6ede1326d3c tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:04.306563 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8d497a8b-595a-4905-8346-a6ede1326d3c tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:04.307012 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8d497a8b-595a-4905-8346-a6ede1326d3c tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:04.307809 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8d497a8b-595a-4905-8346-a6ede1326d3c tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:04.308249 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-8d497a8b-595a-4905-8346-a6ede1326d3c tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:04.451631 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-8d497a8b-595a-4905-8346-a6ede1326d3c tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:04.459794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-8d497a8b-595a-4905-8346-a6ede1326d3c tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.165160 Jul 21 22:46:04.460365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 456/961] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:04 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:05.477649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ad5bbf6b-fe14-4590-8ab6-b1d486237a2f tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:05.478281 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ad5bbf6b-fe14-4590-8ab6-b1d486237a2f tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:05.485021 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ad5bbf6b-fe14-4590-8ab6-b1d486237a2f tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:05.485468 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ad5bbf6b-fe14-4590-8ab6-b1d486237a2f tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:05.486231 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ad5bbf6b-fe14-4590-8ab6-b1d486237a2f tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:05.486667 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ad5bbf6b-fe14-4590-8ab6-b1d486237a2f tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:05.618695 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ad5bbf6b-fe14-4590-8ab6-b1d486237a2f tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:05.626087 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ad5bbf6b-fe14-4590-8ab6-b1d486237a2f tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.152495 Jul 21 22:46:05.626643 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 506/962] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:05 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:06.643867 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-3450d93c-cfc4-45d1-931f-0d4ae3b65790 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:06.645400 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-3450d93c-cfc4-45d1-931f-0d4ae3b65790 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:06.651469 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3450d93c-cfc4-45d1-931f-0d4ae3b65790 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:06.651909 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3450d93c-cfc4-45d1-931f-0d4ae3b65790 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:06.652666 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3450d93c-cfc4-45d1-931f-0d4ae3b65790 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:06.653097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-3450d93c-cfc4-45d1-931f-0d4ae3b65790 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:06.787859 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-3450d93c-cfc4-45d1-931f-0d4ae3b65790 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:06.795537 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-3450d93c-cfc4-45d1-931f-0d4ae3b65790 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.155545 Jul 21 22:46:06.796101 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 457/963] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:06 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:07.813037 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-90a99198-ba2e-4cac-9690-e0e481a5b621 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:07.813651 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-90a99198-ba2e-4cac-9690-e0e481a5b621 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:07.820002 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-90a99198-ba2e-4cac-9690-e0e481a5b621 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:07.820466 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-90a99198-ba2e-4cac-9690-e0e481a5b621 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:07.821231 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-90a99198-ba2e-4cac-9690-e0e481a5b621 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:07.821665 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-90a99198-ba2e-4cac-9690-e0e481a5b621 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:07.951600 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-90a99198-ba2e-4cac-9690-e0e481a5b621 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:07.959275 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-90a99198-ba2e-4cac-9690-e0e481a5b621 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.150198 Jul 21 22:46:07.959649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 507/964] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:07 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:08.976135 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-6cdeb085-4354-4ad9-aeb7-81b85c5d5d43 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:08.976773 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-6cdeb085-4354-4ad9-aeb7-81b85c5d5d43 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:08.983279 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6cdeb085-4354-4ad9-aeb7-81b85c5d5d43 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:08.983726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6cdeb085-4354-4ad9-aeb7-81b85c5d5d43 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:08.984498 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6cdeb085-4354-4ad9-aeb7-81b85c5d5d43 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:08.984939 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-6cdeb085-4354-4ad9-aeb7-81b85c5d5d43 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:09.135076 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-6cdeb085-4354-4ad9-aeb7-81b85c5d5d43 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:09.142988 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-6cdeb085-4354-4ad9-aeb7-81b85c5d5d43 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.170928 Jul 21 22:46:09.143586 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 458/965] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:08 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:10.160224 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-85a80250-9fb0-4300-adee-aa672cc0f3f3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:10.160830 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-85a80250-9fb0-4300-adee-aa672cc0f3f3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:10.167299 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-85a80250-9fb0-4300-adee-aa672cc0f3f3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:10.167743 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-85a80250-9fb0-4300-adee-aa672cc0f3f3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:10.168494 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-85a80250-9fb0-4300-adee-aa672cc0f3f3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:10.168924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-85a80250-9fb0-4300-adee-aa672cc0f3f3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:10.306214 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-85a80250-9fb0-4300-adee-aa672cc0f3f3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:10.313677 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-85a80250-9fb0-4300-adee-aa672cc0f3f3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.157375 Jul 21 22:46:10.314243 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 508/966] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:10 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:11.331749 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-ee6c0586-ac89-4312-9bb3-2adf4a697ba2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:11.332874 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-ee6c0586-ac89-4312-9bb3-2adf4a697ba2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:11.338989 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ee6c0586-ac89-4312-9bb3-2adf4a697ba2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:11.339475 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ee6c0586-ac89-4312-9bb3-2adf4a697ba2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:11.340246 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ee6c0586-ac89-4312-9bb3-2adf4a697ba2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:11.340686 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ee6c0586-ac89-4312-9bb3-2adf4a697ba2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:11.475435 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-ee6c0586-ac89-4312-9bb3-2adf4a697ba2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:11.482955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-ee6c0586-ac89-4312-9bb3-2adf4a697ba2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.155136 Jul 21 22:46:11.483546 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 459/967] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:11 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:12.501121 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-d5f17861-2467-4cef-bdd2-2e12a528ebf2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:12.501721 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-d5f17861-2467-4cef-bdd2-2e12a528ebf2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:12.509225 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d5f17861-2467-4cef-bdd2-2e12a528ebf2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:12.509671 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d5f17861-2467-4cef-bdd2-2e12a528ebf2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:12.510418 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d5f17861-2467-4cef-bdd2-2e12a528ebf2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:12.510859 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-d5f17861-2467-4cef-bdd2-2e12a528ebf2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:12.647200 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-d5f17861-2467-4cef-bdd2-2e12a528ebf2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:12.654787 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-d5f17861-2467-4cef-bdd2-2e12a528ebf2 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.157556 Jul 21 22:46:12.655465 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 509/968] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:12 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:13.672054 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-09473a4b-6a21-4d82-afee-b4376b1c64d5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:13.672778 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-09473a4b-6a21-4d82-afee-b4376b1c64d5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:13.680201 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-09473a4b-6a21-4d82-afee-b4376b1c64d5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:13.680659 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-09473a4b-6a21-4d82-afee-b4376b1c64d5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:13.681425 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-09473a4b-6a21-4d82-afee-b4376b1c64d5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:13.681855 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-09473a4b-6a21-4d82-afee-b4376b1c64d5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:13.827305 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-09473a4b-6a21-4d82-afee-b4376b1c64d5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:13.834087 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-09473a4b-6a21-4d82-afee-b4376b1c64d5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.165819 Jul 21 22:46:13.834678 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 460/969] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:13 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:14.851745 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-0d1bd78b-25e4-417f-a79d-368eeb554d25 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:14.852356 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-0d1bd78b-25e4-417f-a79d-368eeb554d25 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:14.858981 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d1bd78b-25e4-417f-a79d-368eeb554d25 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:14.859464 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d1bd78b-25e4-417f-a79d-368eeb554d25 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:14.860227 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d1bd78b-25e4-417f-a79d-368eeb554d25 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:14.860664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-0d1bd78b-25e4-417f-a79d-368eeb554d25 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:14.993859 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-0d1bd78b-25e4-417f-a79d-368eeb554d25 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:15.002349 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-0d1bd78b-25e4-417f-a79d-368eeb554d25 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.154527 Jul 21 22:46:15.003165 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 510/970] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:14 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:15.131783 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-870495582", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-67081037", "security_groups": [{"name": "tempest-secgroup-smoke-1368037390"}], "block_device_mapping_v2": [{"uuid": "3ea0947f-6bee-47fb-8b5e-b61778e86e60", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "60f1b2e3-fd49-40e5-9c63-36eb47bcf006"}]}} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:15.245181 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.network.neutron [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] validate_networks() for [('60f1b2e3-fd49-40e5-9c63-36eb47bcf006', None, None, None, None, None)] {{(pid=124497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:46:15.630474 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Flavor limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:46:15.632141 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Image limits 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:46:15.632641 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Flavor pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:46:15.633061 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Image pref 0:0:0 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:46:15.633471 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.virt.hardware [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:46:15.642452 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:15.642904 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:15.643737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:15.644178 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:15.663506 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Getting quotas for project e61e273f945e45f0a6e1f3b45e4bc9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:46:15.667593 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.quota [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Getting quotas for user a367906e74654507aaed8b885d525a0f and project e61e273f945e45f0a6e1f3b45e4bc9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=124497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:46:15.729619 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Going to run 1 instances... {{(pid=124497) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:46:15.731786 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ea0947f-6bee-47fb-8b5e-b61778e86e60',volume_size=None,volume_type=None)] {{(pid=124497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:46:15.865510 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-4d4bd12c-8e4a-45ee-80f0-2e37a56a8af7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.737743 Jul 21 22:46:15.866160 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 461/971] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jul 21 22:46:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:46:15.876041 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-92592259-1851-4af0-a91d-62daeb22e023 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:15.876648 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-92592259-1851-4af0-a91d-62daeb22e023 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:15.930102 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-92592259-1851-4af0-a91d-62daeb22e023 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:15.936825 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-92592259-1851-4af0-a91d-62daeb22e023 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1092 microversion: 2.1 time: 0.064592 Jul 21 22:46:15.937385 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 511/972] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:15 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:16.020822 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-50aea110-f0f5-4933-9df6-58bae17ea774 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:16.022511 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-50aea110-f0f5-4933-9df6-58bae17ea774 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:16.029402 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-50aea110-f0f5-4933-9df6-58bae17ea774 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:16.029857 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-50aea110-f0f5-4933-9df6-58bae17ea774 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:16.030682 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-50aea110-f0f5-4933-9df6-58bae17ea774 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:16.031136 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-50aea110-f0f5-4933-9df6-58bae17ea774 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:16.172124 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-50aea110-f0f5-4933-9df6-58bae17ea774 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:16.180553 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-50aea110-f0f5-4933-9df6-58bae17ea774 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1569 microversion: 2.1 time: 0.163733 Jul 21 22:46:16.181125 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 462/973] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:16 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:16.197023 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7d8a5fe4-fd69-4fe3-9a78-4f70f00e24d6 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:16.197596 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7d8a5fe4-fd69-4fe3-9a78-4f70f00e24d6 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:16.203800 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7d8a5fe4-fd69-4fe3-9a78-4f70f00e24d6 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:16.204250 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7d8a5fe4-fd69-4fe3-9a78-4f70f00e24d6 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:16.205019 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7d8a5fe4-fd69-4fe3-9a78-4f70f00e24d6 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:16.205460 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7d8a5fe4-fd69-4fe3-9a78-4f70f00e24d6 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:16.338532 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7d8a5fe4-fd69-4fe3-9a78-4f70f00e24d6 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [35dd9b6a-116f-47e0-ba17-3adcfd0ba6b6] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:46:16.953989 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-cc0a83c7-b480-42e4-a073-e464db016b2a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:16.954608 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-cc0a83c7-b480-42e4-a073-e464db016b2a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:17.011833 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-cc0a83c7-b480-42e4-a073-e464db016b2a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:17.018791 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-cc0a83c7-b480-42e4-a073-e464db016b2a tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1092 microversion: 2.1 time: 0.068804 Jul 21 22:46:17.019396 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 463/974] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:16 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1092 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:46:17.346055 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO oslo.messaging._drivers.impl_rabbit [None req-7d8a5fe4-fd69-4fe3-9a78-4f70f00e24d6 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [35dd9b6a-116f-47e0-ba17-3adcfd0ba6b6] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34016. Jul 21 22:46:17.349217 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7d8a5fe4-fd69-4fe3-9a78-4f70f00e24d6 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "POST /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0/action" status: 202 len: 0 microversion: 2.1 time: 1.156677 Jul 21 22:46:17.350041 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 512/975] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jul 21 22:46:16 2022] POST /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0/action => generated 0 bytes in 1158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:46:17.358471 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-78f297a8-2806-4044-a5da-5b98009596b3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:17.359086 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-78f297a8-2806-4044-a5da-5b98009596b3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:17.366731 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-78f297a8-2806-4044-a5da-5b98009596b3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:17.367218 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-78f297a8-2806-4044-a5da-5b98009596b3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:17.367991 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-78f297a8-2806-4044-a5da-5b98009596b3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:17.368432 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-78f297a8-2806-4044-a5da-5b98009596b3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:17.536122 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-78f297a8-2806-4044-a5da-5b98009596b3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:17.544263 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-78f297a8-2806-4044-a5da-5b98009596b3 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1517 microversion: 2.1 time: 0.189624 Jul 21 22:46:17.544839 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 464/976] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:17 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:18.037169 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-bd9b02cc-4ced-4d6a-b192-02788664d5f7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:18.038071 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-bd9b02cc-4ced-4d6a-b192-02788664d5f7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:18.098676 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-bd9b02cc-4ced-4d6a-b192-02788664d5f7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:18.105777 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-bd9b02cc-4ced-4d6a-b192-02788664d5f7 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1092 microversion: 2.1 time: 0.072721 Jul 21 22:46:18.106333 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 513/977] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:18 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1092 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:18.561892 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-a6c28f63-0a3e-4465-81d1-69cf52aaf043 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:18.562468 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-a6c28f63-0a3e-4465-81d1-69cf52aaf043 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:18.568885 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a6c28f63-0a3e-4465-81d1-69cf52aaf043 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:18.569705 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a6c28f63-0a3e-4465-81d1-69cf52aaf043 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:18.570477 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a6c28f63-0a3e-4465-81d1-69cf52aaf043 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:18.570908 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-a6c28f63-0a3e-4465-81d1-69cf52aaf043 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:18.702187 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-a6c28f63-0a3e-4465-81d1-69cf52aaf043 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:18.710278 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-a6c28f63-0a3e-4465-81d1-69cf52aaf043 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1575 microversion: 2.1 time: 0.151895 Jul 21 22:46:18.710844 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 465/978] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:18 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:19.122646 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ca7df1ff-a6ad-4cd6-9094-d1d8e7a9acbb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:19.124966 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ca7df1ff-a6ad-4cd6-9094-d1d8e7a9acbb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:19.182429 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ca7df1ff-a6ad-4cd6-9094-d1d8e7a9acbb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:19.190149 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ca7df1ff-a6ad-4cd6-9094-d1d8e7a9acbb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1092 microversion: 2.1 time: 0.071357 Jul 21 22:46:19.191352 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 514/979] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:19 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1092 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:19.509023 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-2180ff17-adc2-4c70-a45e-15c520264006 req-29ae1816-26f5-4ee3-afc9-df10bc8b5aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d84fc6-e89a-4c35-ad6a-924c70acb1f0", "name": "network-vif-unplugged", "status": "completed", "tag": "bd5d91b1-4dba-4a6d-b88e-220beafc270e"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:19.518110 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-2180ff17-adc2-4c70-a45e-15c520264006 req-29ae1816-26f5-4ee3-afc9-df10bc8b5aa0 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:19.518559 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-2180ff17-adc2-4c70-a45e-15c520264006 req-29ae1816-26f5-4ee3-afc9-df10bc8b5aa0 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:19.531823 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-2180ff17-adc2-4c70-a45e-15c520264006 req-29ae1816-26f5-4ee3-afc9-df10bc8b5aa0 service nova] Creating event network-vif-unplugged:bd5d91b1-4dba-4a6d-b88e-220beafc270e for instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 on hv-cinder-85069 Jul 21 22:46:19.536716 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-2180ff17-adc2-4c70-a45e-15c520264006 req-29ae1816-26f5-4ee3-afc9-df10bc8b5aa0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032090 Jul 21 22:46:19.537311 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 466/980] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:19.728032 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ad3ac389-9c91-4706-9f45-75ed4782c1e0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:19.728629 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ad3ac389-9c91-4706-9f45-75ed4782c1e0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:19.735094 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ad3ac389-9c91-4706-9f45-75ed4782c1e0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:19.735539 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ad3ac389-9c91-4706-9f45-75ed4782c1e0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:19.736295 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ad3ac389-9c91-4706-9f45-75ed4782c1e0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:19.736724 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ad3ac389-9c91-4706-9f45-75ed4782c1e0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:19.871243 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ad3ac389-9c91-4706-9f45-75ed4782c1e0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:19.878773 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ad3ac389-9c91-4706-9f45-75ed4782c1e0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1575 microversion: 2.1 time: 0.155090 Jul 21 22:46:19.879361 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 515/981] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:19 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:20.207637 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-80d2f459-c66e-4647-8517-cb28f68c7bdb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:20.208327 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-80d2f459-c66e-4647-8517-cb28f68c7bdb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:20.215670 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-80d2f459-c66e-4647-8517-cb28f68c7bdb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:20.216052 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-80d2f459-c66e-4647-8517-cb28f68c7bdb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:20.216827 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-80d2f459-c66e-4647-8517-cb28f68c7bdb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:20.217263 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-80d2f459-c66e-4647-8517-cb28f68c7bdb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:20.278975 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-80d2f459-c66e-4647-8517-cb28f68c7bdb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:20.286662 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-80d2f459-c66e-4647-8517-cb28f68c7bdb tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1142 microversion: 2.1 time: 0.083326 Jul 21 22:46:20.287264 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 467/982] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:20 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1142 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:20.895919 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-39a82e3d-a917-4924-8115-91f7a3778c90 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:20.896530 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-39a82e3d-a917-4924-8115-91f7a3778c90 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:20.903750 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39a82e3d-a917-4924-8115-91f7a3778c90 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:20.904199 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39a82e3d-a917-4924-8115-91f7a3778c90 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:20.905139 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39a82e3d-a917-4924-8115-91f7a3778c90 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:20.905573 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-39a82e3d-a917-4924-8115-91f7a3778c90 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:21.048781 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-39a82e3d-a917-4924-8115-91f7a3778c90 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:21.056916 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-39a82e3d-a917-4924-8115-91f7a3778c90 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1575 microversion: 2.1 time: 0.164971 Jul 21 22:46:21.057502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 516/983] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:20 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:21.304114 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b55d1aab-5ae8-414b-9d27-46a3f695adfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:21.304715 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b55d1aab-5ae8-414b-9d27-46a3f695adfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:21.311634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b55d1aab-5ae8-414b-9d27-46a3f695adfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:21.312092 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b55d1aab-5ae8-414b-9d27-46a3f695adfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:21.312830 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b55d1aab-5ae8-414b-9d27-46a3f695adfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:21.313265 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b55d1aab-5ae8-414b-9d27-46a3f695adfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:21.389742 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-b55d1aab-5ae8-414b-9d27-46a3f695adfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:21.399612 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b55d1aab-5ae8-414b-9d27-46a3f695adfe tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1208 microversion: 2.1 time: 0.099277 Jul 21 22:46:21.409747 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 468/984] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:21 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1208 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:22.075511 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8dec8bb4-6c28-40b5-b068-5645420e1c58 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:22.076108 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8dec8bb4-6c28-40b5-b068-5645420e1c58 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:22.082500 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8dec8bb4-6c28-40b5-b068-5645420e1c58 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:22.083282 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8dec8bb4-6c28-40b5-b068-5645420e1c58 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:22.084227 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8dec8bb4-6c28-40b5-b068-5645420e1c58 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:22.085559 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8dec8bb4-6c28-40b5-b068-5645420e1c58 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:22.244578 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8dec8bb4-6c28-40b5-b068-5645420e1c58 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:22.253365 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-53d055bc-a251-4f2c-ab87-6d8545e0e518 req-f7d23075-d39f-4034-8899-bff8acfc3500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8862619a-3552-4344-80cb-5aab5c4b2036", "tag": "df811b45-30bd-4c0e-8859-b01e67fa4c7c"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:22.269323 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8dec8bb4-6c28-40b5-b068-5645420e1c58 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1575 microversion: 2.1 time: 0.198087 Jul 21 22:46:22.273421 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-53d055bc-a251-4f2c-ab87-6d8545e0e518 req-f7d23075-d39f-4034-8899-bff8acfc3500 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:22.274611 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 517/985] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:22 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:22.275484 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-53d055bc-a251-4f2c-ab87-6d8545e0e518 req-f7d23075-d39f-4034-8899-bff8acfc3500 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:22.290650 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-53d055bc-a251-4f2c-ab87-6d8545e0e518 req-f7d23075-d39f-4034-8899-bff8acfc3500 service nova] Creating event network-changed:df811b45-30bd-4c0e-8859-b01e67fa4c7c for instance 8862619a-3552-4344-80cb-5aab5c4b2036 on hv-cinder-85069 Jul 21 22:46:22.295695 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-53d055bc-a251-4f2c-ab87-6d8545e0e518 req-f7d23075-d39f-4034-8899-bff8acfc3500 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047821 Jul 21 22:46:22.296517 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 469/986] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:46:22.417179 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-69c884e5-cac9-4bab-b3f3-fb95f03eb6c6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:22.418054 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-69c884e5-cac9-4bab-b3f3-fb95f03eb6c6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:22.424382 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-69c884e5-cac9-4bab-b3f3-fb95f03eb6c6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:22.424839 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-69c884e5-cac9-4bab-b3f3-fb95f03eb6c6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:22.425654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-69c884e5-cac9-4bab-b3f3-fb95f03eb6c6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:22.426095 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-69c884e5-cac9-4bab-b3f3-fb95f03eb6c6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:22.561701 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-69c884e5-cac9-4bab-b3f3-fb95f03eb6c6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:22.570240 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-69c884e5-cac9-4bab-b3f3-fb95f03eb6c6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1264 microversion: 2.1 time: 0.157160 Jul 21 22:46:22.570746 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 518/987] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:22 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:23.291777 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f1a11308-03e1-45e0-9d8e-fa886f100ae5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:23.292511 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f1a11308-03e1-45e0-9d8e-fa886f100ae5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:23.299669 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1a11308-03e1-45e0-9d8e-fa886f100ae5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:23.300127 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1a11308-03e1-45e0-9d8e-fa886f100ae5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:23.300912 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1a11308-03e1-45e0-9d8e-fa886f100ae5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:23.301348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f1a11308-03e1-45e0-9d8e-fa886f100ae5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:23.453290 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f1a11308-03e1-45e0-9d8e-fa886f100ae5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:23.462733 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f1a11308-03e1-45e0-9d8e-fa886f100ae5 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1575 microversion: 2.1 time: 0.176497 Jul 21 22:46:23.463363 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 470/988] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:23 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:23.588950 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-71d6ddfc-e1dd-4fd9-8a80-cdb6b8a90bf8 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:23.589523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-71d6ddfc-e1dd-4fd9-8a80-cdb6b8a90bf8 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:23.595922 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-71d6ddfc-e1dd-4fd9-8a80-cdb6b8a90bf8 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:23.596378 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-71d6ddfc-e1dd-4fd9-8a80-cdb6b8a90bf8 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:23.597157 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-71d6ddfc-e1dd-4fd9-8a80-cdb6b8a90bf8 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:23.597596 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-71d6ddfc-e1dd-4fd9-8a80-cdb6b8a90bf8 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:23.728725 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-71d6ddfc-e1dd-4fd9-8a80-cdb6b8a90bf8 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:23.736167 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-71d6ddfc-e1dd-4fd9-8a80-cdb6b8a90bf8 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1264 microversion: 2.1 time: 0.153025 Jul 21 22:46:23.736733 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 519/989] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:23 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:24.480660 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9a3c14d1-f1ff-4476-ae18-a6ba8a54e882 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:24.481266 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-9a3c14d1-f1ff-4476-ae18-a6ba8a54e882 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:24.487905 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9a3c14d1-f1ff-4476-ae18-a6ba8a54e882 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:24.488334 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9a3c14d1-f1ff-4476-ae18-a6ba8a54e882 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:24.489095 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9a3c14d1-f1ff-4476-ae18-a6ba8a54e882 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:24.489529 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9a3c14d1-f1ff-4476-ae18-a6ba8a54e882 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:24.624355 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-9a3c14d1-f1ff-4476-ae18-a6ba8a54e882 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:24.632041 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-9a3c14d1-f1ff-4476-ae18-a6ba8a54e882 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1575 microversion: 2.1 time: 0.155373 Jul 21 22:46:24.632615 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 471/990] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:24 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:24.753824 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-43a65578-b20a-4c75-bb90-39d0a4710518 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:24.754378 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-43a65578-b20a-4c75-bb90-39d0a4710518 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:24.761106 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43a65578-b20a-4c75-bb90-39d0a4710518 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:24.761558 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43a65578-b20a-4c75-bb90-39d0a4710518 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:24.762576 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43a65578-b20a-4c75-bb90-39d0a4710518 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:24.763014 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-43a65578-b20a-4c75-bb90-39d0a4710518 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:24.892813 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-43a65578-b20a-4c75-bb90-39d0a4710518 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:24.901098 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-43a65578-b20a-4c75-bb90-39d0a4710518 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1264 microversion: 2.1 time: 0.151264 Jul 21 22:46:24.901644 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 520/991] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:24 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:25.649454 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f510e82f-a0e6-4af4-96f8-c0aeb17fb8fb tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:25.650071 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f510e82f-a0e6-4af4-96f8-c0aeb17fb8fb tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:25.653131 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=2 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:25.660578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f510e82f-a0e6-4af4-96f8-c0aeb17fb8fb tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:25.661256 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f510e82f-a0e6-4af4-96f8-c0aeb17fb8fb tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:25.662464 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f510e82f-a0e6-4af4-96f8-c0aeb17fb8fb tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:25.663159 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f510e82f-a0e6-4af4-96f8-c0aeb17fb8fb tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:25.681562 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:25.797492 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f510e82f-a0e6-4af4-96f8-c0aeb17fb8fb tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:25.804955 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f510e82f-a0e6-4af4-96f8-c0aeb17fb8fb tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1575 microversion: 2.1 time: 0.159544 Jul 21 22:46:25.805528 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 472/992] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:25 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:25.917922 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6b1644ea-a1b8-404a-8c57-0e4178187c54 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:25.918487 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6b1644ea-a1b8-404a-8c57-0e4178187c54 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:25.925519 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6b1644ea-a1b8-404a-8c57-0e4178187c54 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:25.925971 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6b1644ea-a1b8-404a-8c57-0e4178187c54 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:25.926738 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6b1644ea-a1b8-404a-8c57-0e4178187c54 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:25.927218 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6b1644ea-a1b8-404a-8c57-0e4178187c54 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:26.058389 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-6b1644ea-a1b8-404a-8c57-0e4178187c54 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:26.065823 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6b1644ea-a1b8-404a-8c57-0e4178187c54 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1264 microversion: 2.1 time: 0.151971 Jul 21 22:46:26.066473 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 521/993] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:25 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:26.341111 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:46:26.341328 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Thu Jul 21 22:46:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:46:26.823011 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-eed5e4b7-e2ac-49af-84b9-11c822ea6c80 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:26.823715 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-eed5e4b7-e2ac-49af-84b9-11c822ea6c80 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:26.830369 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-eed5e4b7-e2ac-49af-84b9-11c822ea6c80 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:26.830824 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-eed5e4b7-e2ac-49af-84b9-11c822ea6c80 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:26.832115 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-eed5e4b7-e2ac-49af-84b9-11c822ea6c80 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:26.832558 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-eed5e4b7-e2ac-49af-84b9-11c822ea6c80 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:26.972643 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-eed5e4b7-e2ac-49af-84b9-11c822ea6c80 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:26.981599 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-eed5e4b7-e2ac-49af-84b9-11c822ea6c80 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1562 microversion: 2.1 time: 0.163895 Jul 21 22:46:26.982211 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 473/994] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:26 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:27.082947 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-ac8ca446-107e-439e-b489-0209d21f5761 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:27.083604 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-ac8ca446-107e-439e-b489-0209d21f5761 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:27.091042 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ac8ca446-107e-439e-b489-0209d21f5761 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:27.091527 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ac8ca446-107e-439e-b489-0209d21f5761 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:27.092299 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ac8ca446-107e-439e-b489-0209d21f5761 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:27.092739 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-ac8ca446-107e-439e-b489-0209d21f5761 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:27.227337 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-ac8ca446-107e-439e-b489-0209d21f5761 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:27.234744 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-ac8ca446-107e-439e-b489-0209d21f5761 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1264 microversion: 2.1 time: 0.155717 Jul 21 22:46:27.235343 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 522/995] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:27 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:28.251622 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-f05daf7b-1b93-4f8c-968a-2d24a5072abd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:28.252268 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-f05daf7b-1b93-4f8c-968a-2d24a5072abd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:28.254097 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell0:SELECT=8 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:28.260489 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f05daf7b-1b93-4f8c-968a-2d24a5072abd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:28.260938 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f05daf7b-1b93-4f8c-968a-2d24a5072abd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:28.261705 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f05daf7b-1b93-4f8c-968a-2d24a5072abd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:28.262391 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-f05daf7b-1b93-4f8c-968a-2d24a5072abd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:28.402711 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-f05daf7b-1b93-4f8c-968a-2d24a5072abd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:28.410455 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-f05daf7b-1b93-4f8c-968a-2d24a5072abd tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1264 microversion: 2.1 time: 0.162803 Jul 21 22:46:28.411022 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 474/996] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:28 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:29.428568 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-9746493f-502a-4dab-8644-75ac38eea980 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:29.429195 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-9746493f-502a-4dab-8644-75ac38eea980 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:29.431828 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell0:SELECT=6 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:29.437859 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9746493f-502a-4dab-8644-75ac38eea980 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:29.438308 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9746493f-502a-4dab-8644-75ac38eea980 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:29.440818 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9746493f-502a-4dab-8644-75ac38eea980 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:29.440818 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-9746493f-502a-4dab-8644-75ac38eea980 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:29.458596 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:29.583737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-66887e9a-4a3a-4855-a6a1-c4e1bc91db8e req-9e54abda-81fb-4300-a655-c9dbccb98368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d84fc6-e89a-4c35-ad6a-924c70acb1f0", "name": "network-vif-plugged", "status": "completed", "tag": "bd5d91b1-4dba-4a6d-b88e-220beafc270e"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:29.598388 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-9746493f-502a-4dab-8644-75ac38eea980 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:29.602491 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-66887e9a-4a3a-4855-a6a1-c4e1bc91db8e req-9e54abda-81fb-4300-a655-c9dbccb98368 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:29.603019 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-66887e9a-4a3a-4855-a6a1-c4e1bc91db8e req-9e54abda-81fb-4300-a655-c9dbccb98368 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:29.608039 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-9746493f-502a-4dab-8644-75ac38eea980 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1264 microversion: 2.1 time: 0.183150 Jul 21 22:46:29.611119 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 523/997] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:29 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:29.614570 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-66887e9a-4a3a-4855-a6a1-c4e1bc91db8e req-9e54abda-81fb-4300-a655-c9dbccb98368 service nova] Creating event network-vif-plugged:bd5d91b1-4dba-4a6d-b88e-220beafc270e for instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 on hv-cinder-85069 Jul 21 22:46:29.620280 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-66887e9a-4a3a-4855-a6a1-c4e1bc91db8e req-9e54abda-81fb-4300-a655-c9dbccb98368 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040236 Jul 21 22:46:29.621084 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 475/998] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:46:30.625884 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-efa03469-8ae6-4da6-a3e9-d34f7e6b1c16 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:30.626488 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-efa03469-8ae6-4da6-a3e9-d34f7e6b1c16 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:30.633910 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-efa03469-8ae6-4da6-a3e9-d34f7e6b1c16 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:30.634358 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-efa03469-8ae6-4da6-a3e9-d34f7e6b1c16 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:30.635232 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-efa03469-8ae6-4da6-a3e9-d34f7e6b1c16 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:30.635601 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-efa03469-8ae6-4da6-a3e9-d34f7e6b1c16 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:30.769538 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-efa03469-8ae6-4da6-a3e9-d34f7e6b1c16 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:30.777213 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-efa03469-8ae6-4da6-a3e9-d34f7e6b1c16 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1264 microversion: 2.1 time: 0.155268 Jul 21 22:46:30.777785 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 524/999] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:30 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:31.794709 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-0482d705-a39e-4fda-9220-dfa7aeec8b78 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:31.795346 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-0482d705-a39e-4fda-9220-dfa7aeec8b78 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:31.802156 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0482d705-a39e-4fda-9220-dfa7aeec8b78 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:31.802634 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0482d705-a39e-4fda-9220-dfa7aeec8b78 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:31.803440 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0482d705-a39e-4fda-9220-dfa7aeec8b78 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:31.803882 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-0482d705-a39e-4fda-9220-dfa7aeec8b78 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:31.941683 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-0482d705-a39e-4fda-9220-dfa7aeec8b78 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:31.949866 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-0482d705-a39e-4fda-9220-dfa7aeec8b78 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1264 microversion: 2.1 time: 0.159440 Jul 21 22:46:31.950471 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 476/1000] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:31 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:32.968676 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-f133d6ff-11b8-4168-bc67-fd4d9361cbb4 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:32.969216 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-f133d6ff-11b8-4168-bc67-fd4d9361cbb4 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:32.976516 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f133d6ff-11b8-4168-bc67-fd4d9361cbb4 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:32.976987 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f133d6ff-11b8-4168-bc67-fd4d9361cbb4 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:32.977769 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f133d6ff-11b8-4168-bc67-fd4d9361cbb4 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:32.978207 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-f133d6ff-11b8-4168-bc67-fd4d9361cbb4 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:33.109495 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-f133d6ff-11b8-4168-bc67-fd4d9361cbb4 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:33.117493 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-f133d6ff-11b8-4168-bc67-fd4d9361cbb4 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1264 microversion: 2.1 time: 0.152795 Jul 21 22:46:33.118074 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 525/1001] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:32 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:33.612584 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-bd6c04f7-501f-411e-bb48-c0d87cb2f0e4 req-95b12a8e-5967-40cf-aa8d-372491b22520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8862619a-3552-4344-80cb-5aab5c4b2036", "name": "network-vif-plugged", "status": "completed", "tag": "df811b45-30bd-4c0e-8859-b01e67fa4c7c"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:33.618625 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:33.625593 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-bd6c04f7-501f-411e-bb48-c0d87cb2f0e4 req-95b12a8e-5967-40cf-aa8d-372491b22520 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:33.626050 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-bd6c04f7-501f-411e-bb48-c0d87cb2f0e4 req-95b12a8e-5967-40cf-aa8d-372491b22520 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:33.638673 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-bd6c04f7-501f-411e-bb48-c0d87cb2f0e4 req-95b12a8e-5967-40cf-aa8d-372491b22520 service nova] Creating event network-vif-plugged:df811b45-30bd-4c0e-8859-b01e67fa4c7c for instance 8862619a-3552-4344-80cb-5aab5c4b2036 on hv-cinder-85069 Jul 21 22:46:33.643516 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-bd6c04f7-501f-411e-bb48-c0d87cb2f0e4 req-95b12a8e-5967-40cf-aa8d-372491b22520 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034665 Jul 21 22:46:33.644121 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 477/1002] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:34.134176 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-204a0ed0-96bc-41d1-9d8a-36584df8a0df tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:34.134807 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-204a0ed0-96bc-41d1-9d8a-36584df8a0df tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:34.137356 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=51 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:34.142668 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-204a0ed0-96bc-41d1-9d8a-36584df8a0df tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:34.143141 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-204a0ed0-96bc-41d1-9d8a-36584df8a0df tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:34.143912 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-204a0ed0-96bc-41d1-9d8a-36584df8a0df tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:34.144350 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-204a0ed0-96bc-41d1-9d8a-36584df8a0df tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:34.278044 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-204a0ed0-96bc-41d1-9d8a-36584df8a0df tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:34.285532 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-204a0ed0-96bc-41d1-9d8a-36584df8a0df tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1264 microversion: 2.1 time: 0.155241 Jul 21 22:46:34.286103 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 526/1003] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:34 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:35.305212 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1c4aaa12-d052-448d-92d1-f172c011b94b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:35.305931 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-1c4aaa12-d052-448d-92d1-f172c011b94b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:35.312179 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1c4aaa12-d052-448d-92d1-f172c011b94b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:35.312641 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1c4aaa12-d052-448d-92d1-f172c011b94b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:35.313411 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1c4aaa12-d052-448d-92d1-f172c011b94b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:35.313852 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-1c4aaa12-d052-448d-92d1-f172c011b94b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:35.449794 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-1c4aaa12-d052-448d-92d1-f172c011b94b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:35.457292 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1c4aaa12-d052-448d-92d1-f172c011b94b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1450 microversion: 2.1 time: 0.157529 Jul 21 22:46:35.457863 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 478/1004] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:35 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:35.473244 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-8e5aa07e-7840-4088-b654-977ba3825f0c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:35.473858 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-8e5aa07e-7840-4088-b654-977ba3825f0c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:35.481149 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8e5aa07e-7840-4088-b654-977ba3825f0c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:35.481599 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8e5aa07e-7840-4088-b654-977ba3825f0c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:35.482364 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8e5aa07e-7840-4088-b654-977ba3825f0c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:35.482801 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-8e5aa07e-7840-4088-b654-977ba3825f0c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:35.620750 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-8e5aa07e-7840-4088-b654-977ba3825f0c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:35.628266 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-8e5aa07e-7840-4088-b654-977ba3825f0c tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1450 microversion: 2.1 time: 0.158997 Jul 21 22:46:35.628830 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 527/1005] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:35 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:37.522618 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-5d73107a-e5ce-48a2-bd41-432817c8ff97 req-a255ee24-9bb2-44f4-bef5-0ff381209605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8862619a-3552-4344-80cb-5aab5c4b2036", "tag": "df811b45-30bd-4c0e-8859-b01e67fa4c7c"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:46:37.531306 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-5d73107a-e5ce-48a2-bd41-432817c8ff97 req-a255ee24-9bb2-44f4-bef5-0ff381209605 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:37.531757 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-5d73107a-e5ce-48a2-bd41-432817c8ff97 req-a255ee24-9bb2-44f4-bef5-0ff381209605 service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:37.542935 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-5d73107a-e5ce-48a2-bd41-432817c8ff97 req-a255ee24-9bb2-44f4-bef5-0ff381209605 service nova] Creating event network-changed:df811b45-30bd-4c0e-8859-b01e67fa4c7c for instance 8862619a-3552-4344-80cb-5aab5c4b2036 on hv-cinder-85069 Jul 21 22:46:37.547893 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-5d73107a-e5ce-48a2-bd41-432817c8ff97 req-a255ee24-9bb2-44f4-bef5-0ff381209605 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029564 Jul 21 22:46:37.548672 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 479/1006] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:47:42.128963 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=5 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:42.129699 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4a5bbff1-206f-48f7-ae74-f7fbfee240b7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:42.130122 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=32 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:42.130373 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4a5bbff1-206f-48f7-ae74-f7fbfee240b7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:42.134229 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=3 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:42.134928 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=26 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:42.141590 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4a5bbff1-206f-48f7-ae74-f7fbfee240b7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:42.142233 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4a5bbff1-206f-48f7-ae74-f7fbfee240b7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:42.143012 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4a5bbff1-206f-48f7-ae74-f7fbfee240b7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:42.143473 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4a5bbff1-206f-48f7-ae74-f7fbfee240b7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:42.171357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4a5bbff1-206f-48f7-ae74-f7fbfee240b7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Going to try to terminate instance {{(pid=124498) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:47:42.199038 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-2afe812c-e3cd-4e41-9237-132c33e41d0b req-593a4f7f-8209-4230-a92e-e86ca788706e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d84fc6-e89a-4c35-ad6a-924c70acb1f0", "tag": "bd5d91b1-4dba-4a6d-b88e-220beafc270e"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:47:42.207623 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-2afe812c-e3cd-4e41-9237-132c33e41d0b req-593a4f7f-8209-4230-a92e-e86ca788706e service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:42.208071 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-2afe812c-e3cd-4e41-9237-132c33e41d0b req-593a4f7f-8209-4230-a92e-e86ca788706e service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:42.220299 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-2afe812c-e3cd-4e41-9237-132c33e41d0b req-593a4f7f-8209-4230-a92e-e86ca788706e service nova] Creating event network-changed:bd5d91b1-4dba-4a6d-b88e-220beafc270e for instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 on hv-cinder-85069 Jul 21 22:47:42.227098 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-2afe812c-e3cd-4e41-9237-132c33e41d0b req-593a4f7f-8209-4230-a92e-e86ca788706e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099103 Jul 21 22:47:42.227977 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 480/1007] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:47:42.269303 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4a5bbff1-206f-48f7-ae74-f7fbfee240b7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "DELETE /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 204 len: 0 microversion: 2.1 time: 0.144409 Jul 21 22:47:42.270207 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 528/1008] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:47:42 2022] DELETE /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:47:42.279112 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-d1bb6f53-04e7-47e6-9a2e-9fde42c74302 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:42.280335 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-d1bb6f53-04e7-47e6-9a2e-9fde42c74302 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:42.287093 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1bb6f53-04e7-47e6-9a2e-9fde42c74302 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:42.288088 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1bb6f53-04e7-47e6-9a2e-9fde42c74302 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:42.288876 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1bb6f53-04e7-47e6-9a2e-9fde42c74302 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:42.289667 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-d1bb6f53-04e7-47e6-9a2e-9fde42c74302 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:42.431747 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-d1bb6f53-04e7-47e6-9a2e-9fde42c74302 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:42.439726 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-d1bb6f53-04e7-47e6-9a2e-9fde42c74302 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.164938 Jul 21 22:47:42.440316 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 481/1009] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:42 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:47:43.458133 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-7caa5f59-5af4-43e0-8ac0-a60c04ac8bb0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:43.459036 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-7caa5f59-5af4-43e0-8ac0-a60c04ac8bb0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:43.466471 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7caa5f59-5af4-43e0-8ac0-a60c04ac8bb0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:43.466918 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7caa5f59-5af4-43e0-8ac0-a60c04ac8bb0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:43.467712 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7caa5f59-5af4-43e0-8ac0-a60c04ac8bb0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:43.468146 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-7caa5f59-5af4-43e0-8ac0-a60c04ac8bb0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:43.605388 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-7caa5f59-5af4-43e0-8ac0-a60c04ac8bb0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:43.612839 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-7caa5f59-5af4-43e0-8ac0-a60c04ac8bb0 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1568 microversion: 2.1 time: 0.159313 Jul 21 22:47:43.613443 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 529/1010] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:43 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:47:44.355037 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [req-26ce5b03-d64d-4300-a24f-69005be46c1d req-8fba3915-2688-4328-804b-7c8571365b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d84fc6-e89a-4c35-ad6a-924c70acb1f0", "name": "network-vif-deleted", "tag": "bd5d91b1-4dba-4a6d-b88e-220beafc270e"}]} {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:47:44.363795 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-26ce5b03-d64d-4300-a24f-69005be46c1d req-8fba3915-2688-4328-804b-7c8571365b1f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:44.364239 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [req-26ce5b03-d64d-4300-a24f-69005be46c1d req-8fba3915-2688-4328-804b-7c8571365b1f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:44.376761 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.compute.server_external_events [req-26ce5b03-d64d-4300-a24f-69005be46c1d req-8fba3915-2688-4328-804b-7c8571365b1f service nova] Creating event network-vif-deleted:bd5d91b1-4dba-4a6d-b88e-220beafc270e for instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 on hv-cinder-85069 Jul 21 22:47:44.382497 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [req-26ce5b03-d64d-4300-a24f-69005be46c1d req-8fba3915-2688-4328-804b-7c8571365b1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031606 Jul 21 22:47:44.383129 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 482/1011] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:47:44.630427 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cc2a1986-c49c-4ba7-80cc-b45c7adb4ac7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:44.631597 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-cc2a1986-c49c-4ba7-80cc-b45c7adb4ac7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:44.639272 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc2a1986-c49c-4ba7-80cc-b45c7adb4ac7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:44.639724 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc2a1986-c49c-4ba7-80cc-b45c7adb4ac7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:44.640504 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc2a1986-c49c-4ba7-80cc-b45c7adb4ac7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:44.640937 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cc2a1986-c49c-4ba7-80cc-b45c7adb4ac7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:44.712760 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-cc2a1986-c49c-4ba7-80cc-b45c7adb4ac7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f06063489847e68831b2c94fac2a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8323020521c94131b7d9bef5aa456a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:44.721271 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-cc2a1986-c49c-4ba7-80cc-b45c7adb4ac7 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 200 len: 1219 microversion: 2.1 time: 0.095304 Jul 21 22:47:44.721854 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 530/1012] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:44 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:47:45.740690 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b5092d7b-e677-4da6-be82-392bd33cf542 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:45.741602 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-b5092d7b-e677-4da6-be82-392bd33cf542 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] [instance: 51d84fc6-e89a-4c35-ad6a-924c70acb1f0] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:45.747861 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5092d7b-e677-4da6-be82-392bd33cf542 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:45.748341 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5092d7b-e677-4da6-be82-392bd33cf542 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:45.749072 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5092d7b-e677-4da6-be82-392bd33cf542 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:45.749506 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-b5092d7b-e677-4da6-be82-392bd33cf542 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:45.763111 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-b5092d7b-e677-4da6-be82-392bd33cf542 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] HTTP exception thrown: Instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 could not be found. Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b5092d7b-e677-4da6-be82-392bd33cf542 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Request method failure captured: Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 HTTP/1.1 Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2daTeQfkEQM9AcHlgZeKNGkC8jR7b3eMcL8m_hHhqQF-Iq-fhq8ps-CGr_S50HCjvw6gGyggZkQNEhH3jE1wonW4ahxrUpfk7mLzN_T0k_ibzNVAhJNPyNp2YTFXMLZwsU_rl6SjqD9hL65jqrKGwgs3M7HOPLoo4a_YEPGLYUzNP50 Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: 8323020521c94131b7d9bef5aa456a70 Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-TestShelveInstance-861313071 Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:47:45.764737 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8323020521c94131b7d9bef5aa456a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8323020521c94131b7d9bef5aa456a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8323020521c94131b7d9bef5aa456a70", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8323020521c94131b7d9bef5aa456a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-TestShelveInstance-861313071 Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: 8323020521c94131b7d9bef5aa456a70 Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-TestShelveInstance-861313071 Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-TestShelveInstance-861313071-project Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: 84f06063489847e68831b2c94fac2a26 Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-TestShelveInstance-861313071-project Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 could not be found. Jul 21 22:47:45.766300 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': '51d84fc6-e89a-4c35-ad6a-924c70acb1f0'} Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 could not be found. Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:47:45.767348 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 could not be found. Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 could not be found. Jul 21 22:47:45.769002 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:47:45.770503 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-b5092d7b-e677-4da6-be82-392bd33cf542 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Returning 404 to user: Instance 51d84fc6-e89a-4c35-ad6a-924c70acb1f0 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:47:45.770503 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-b5092d7b-e677-4da6-be82-392bd33cf542 tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0" status: 404 len: 111 microversion: 2.1 time: 0.030352 Jul 21 22:47:45.770503 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 483/1013] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:45 2022] GET /compute/v2.1/servers/51d84fc6-e89a-4c35-ad6a-924c70acb1f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:47:45.936374 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-86b6592c-8188-4ee1-a732-1ae41ab46c0d tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] Calling method '.version_select at 0x7f47e66bf790>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:45.961266 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-86b6592c-8188-4ee1-a732-1ae41ab46c0d tempest-TestShelveInstance-861313071 tempest-TestShelveInstance-861313071-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1033363760" status: 202 len: 0 microversion: 2.1 time: 0.028116 Jul 21 22:47:45.961870 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 531/1014] 10.222.0.58 () {58 vars in 1253 bytes} [Thu Jul 21 22:47:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1033363760 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:48:17.533374 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-7fa1892a-1c65-422f-9811-64304611d1b2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:17.533961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:17.534340 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7fa1892a-1c65-422f-9811-64304611d1b2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:17.535357 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG dbcounter [-] [124498] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:17.537800 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_api:SELECT=8 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:17.539126 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG dbcounter [-] [124497] Writing DB stats nova_cell1:SELECT=12 {{(pid=124497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:17.540256 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-4439f0f1-ef31-4cbb-b227-af01e26050d7 req-f0c15e42-5e63-4d14-90dd-61014f3e396f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8862619a-3552-4344-80cb-5aab5c4b2036", "tag": "df811b45-30bd-4c0e-8859-b01e67fa4c7c"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:48:17.544544 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7fa1892a-1c65-422f-9811-64304611d1b2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:17.545000 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7fa1892a-1c65-422f-9811-64304611d1b2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:17.545780 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7fa1892a-1c65-422f-9811-64304611d1b2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:17.546230 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-7fa1892a-1c65-422f-9811-64304611d1b2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:17.553502 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-4439f0f1-ef31-4cbb-b227-af01e26050d7 req-f0c15e42-5e63-4d14-90dd-61014f3e396f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:17.554098 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-4439f0f1-ef31-4cbb-b227-af01e26050d7 req-f0c15e42-5e63-4d14-90dd-61014f3e396f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:17.566393 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-4439f0f1-ef31-4cbb-b227-af01e26050d7 req-f0c15e42-5e63-4d14-90dd-61014f3e396f service nova] Creating event network-changed:df811b45-30bd-4c0e-8859-b01e67fa4c7c for instance 8862619a-3552-4344-80cb-5aab5c4b2036 on hv-cinder-85069 Jul 21 22:48:17.572639 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-4439f0f1-ef31-4cbb-b227-af01e26050d7 req-f0c15e42-5e63-4d14-90dd-61014f3e396f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040371 Jul 21 22:48:17.573549 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 532/1015] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:48:17.576596 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-7fa1892a-1c65-422f-9811-64304611d1b2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:48:17.660157 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-7fa1892a-1c65-422f-9811-64304611d1b2 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 204 len: 0 microversion: 2.1 time: 0.130831 Jul 21 22:48:17.663571 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 484/1016] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:48:17 2022] DELETE /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:48:17.672088 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-b04a3a5b-30a2-4e51-88d3-a34c7320b362 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:17.673797 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-b04a3a5b-30a2-4e51-88d3-a34c7320b362 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:17.682271 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b04a3a5b-30a2-4e51-88d3-a34c7320b362 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:17.682852 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b04a3a5b-30a2-4e51-88d3-a34c7320b362 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:17.683782 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b04a3a5b-30a2-4e51-88d3-a34c7320b362 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:17.684417 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-b04a3a5b-30a2-4e51-88d3-a34c7320b362 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:17.830749 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-b04a3a5b-30a2-4e51-88d3-a34c7320b362 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:48:17.838828 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-b04a3a5b-30a2-4e51-88d3-a34c7320b362 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1575 microversion: 2.1 time: 0.171055 Jul 21 22:48:17.839440 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 533/1017] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:48:17 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:48:18.857796 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-ab402aee-ab8f-4585-b6f8-d9d149e3d9d6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:18.858489 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-ab402aee-ab8f-4585-b6f8-d9d149e3d9d6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:18.864622 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ab402aee-ab8f-4585-b6f8-d9d149e3d9d6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:18.865057 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ab402aee-ab8f-4585-b6f8-d9d149e3d9d6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:18.865818 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ab402aee-ab8f-4585-b6f8-d9d149e3d9d6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:18.866243 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-ab402aee-ab8f-4585-b6f8-d9d149e3d9d6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:19.005228 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-ab402aee-ab8f-4585-b6f8-d9d149e3d9d6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:48:19.014441 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-ab402aee-ab8f-4585-b6f8-d9d149e3d9d6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1575 microversion: 2.1 time: 0.160990 Jul 21 22:48:19.015041 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 485/1018] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:48:18 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:48:19.638045 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-4be2743f-6748-4616-9d1c-cb66ad8ebb46 req-64c9dac4-e844-4bfd-b57c-14b928aee97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8862619a-3552-4344-80cb-5aab5c4b2036", "name": "network-vif-deleted", "tag": "df811b45-30bd-4c0e-8859-b01e67fa4c7c"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:48:19.646544 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-4be2743f-6748-4616-9d1c-cb66ad8ebb46 req-64c9dac4-e844-4bfd-b57c-14b928aee97f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:19.646990 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-4be2743f-6748-4616-9d1c-cb66ad8ebb46 req-64c9dac4-e844-4bfd-b57c-14b928aee97f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:19.660624 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-4be2743f-6748-4616-9d1c-cb66ad8ebb46 req-64c9dac4-e844-4bfd-b57c-14b928aee97f service nova] Creating event network-vif-deleted:df811b45-30bd-4c0e-8859-b01e67fa4c7c for instance 8862619a-3552-4344-80cb-5aab5c4b2036 on hv-cinder-85069 Jul 21 22:48:19.664529 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-4be2743f-6748-4616-9d1c-cb66ad8ebb46 req-64c9dac4-e844-4bfd-b57c-14b928aee97f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030415 Jul 21 22:48:19.665285 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 534/1019] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:48:20.032731 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-aa48ebde-cbf9-4a82-a42f-9f2b778b8a53 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:20.033341 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-aa48ebde-cbf9-4a82-a42f-9f2b778b8a53 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:20.041535 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aa48ebde-cbf9-4a82-a42f-9f2b778b8a53 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:20.041988 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aa48ebde-cbf9-4a82-a42f-9f2b778b8a53 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:20.042768 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aa48ebde-cbf9-4a82-a42f-9f2b778b8a53 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:20.043237 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aa48ebde-cbf9-4a82-a42f-9f2b778b8a53 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:20.075805 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aa48ebde-cbf9-4a82-a42f-9f2b778b8a53 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:20.076483 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-aa48ebde-cbf9-4a82-a42f-9f2b778b8a53 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:20.076686 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-aa48ebde-cbf9-4a82-a42f-9f2b778b8a53 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lazy-loading 'fault' on Instance uuid 8862619a-3552-4344-80cb-5aab5c4b2036 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:48:20.119791 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-aa48ebde-cbf9-4a82-a42f-9f2b778b8a53 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:48:20.127220 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-aa48ebde-cbf9-4a82-a42f-9f2b778b8a53 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 200 len: 1228 microversion: 2.1 time: 0.098501 Jul 21 22:48:20.127788 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 486/1020] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:48:20 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 1228 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:48:21.146607 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6bc40ee1-5f4e-4ab1-ac64-39febe49df20 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:21.147346 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-6bc40ee1-5f4e-4ab1-ac64-39febe49df20 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 8862619a-3552-4344-80cb-5aab5c4b2036] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:21.153517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6bc40ee1-5f4e-4ab1-ac64-39febe49df20 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:21.153965 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6bc40ee1-5f4e-4ab1-ac64-39febe49df20 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:21.154757 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6bc40ee1-5f4e-4ab1-ac64-39febe49df20 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:21.155225 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-6bc40ee1-5f4e-4ab1-ac64-39febe49df20 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:21.168801 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-6bc40ee1-5f4e-4ab1-ac64-39febe49df20 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] HTTP exception thrown: Instance 8862619a-3552-4344-80cb-5aab5c4b2036 could not be found. Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6bc40ee1-5f4e-4ab1-ac64-39febe49df20 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Request method failure captured: Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 HTTP/1.1 Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dYbepniAuzydudqj9jHfd7hasx6r9Z3U-8l004a4-wK6Um_4WxYWFbgk8Te9BObBrOt0qWt2Tx5OQQpYeB0uNfsw_uv8kTWWNl_ozGedGRLvrG2V6Z_OeVgqtxPsnIfLKkFltKzmwfWauo-CMH8vo1AebQte2yt0UU6pbeI8Woup_o Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: e61e273f945e45f0a6e1f3b45e4bc9d2 Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:48:21.170394 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e61e273f945e45f0a6e1f3b45e4bc9d2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: e61e273f945e45f0a6e1f3b45e4bc9d2 Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-TestVolumeBootPattern-1281267028-project Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: a367906e74654507aaed8b885d525a0f Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-TestVolumeBootPattern-1281267028-project Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 8862619a-3552-4344-80cb-5aab5c4b2036 could not be found. Jul 21 22:48:21.172134 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '8862619a-3552-4344-80cb-5aab5c4b2036'} Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8862619a-3552-4344-80cb-5aab5c4b2036 could not be found. Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:48:21.173059 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8862619a-3552-4344-80cb-5aab5c4b2036 could not be found. Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8862619a-3552-4344-80cb-5aab5c4b2036 could not be found. Jul 21 22:48:21.174649 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:21.176084 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-6bc40ee1-5f4e-4ab1-ac64-39febe49df20 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Returning 404 to user: Instance 8862619a-3552-4344-80cb-5aab5c4b2036 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:48:21.176084 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-6bc40ee1-5f4e-4ab1-ac64-39febe49df20 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036" status: 404 len: 111 microversion: 2.1 time: 0.029845 Jul 21 22:48:21.176084 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 535/1021] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:48:21 2022] GET /compute/v2.1/servers/8862619a-3552-4344-80cb-5aab5c4b2036 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:48:24.489615 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-29f60fca-7457-405e-bac8-e5ce5b4baa66 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:24.490343 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-29f60fca-7457-405e-bac8-e5ce5b4baa66 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:24.492199 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-634092dc-a689-4b30-807c-0f206f122b01 req-c1a770d8-f2f2-433a-a998-12b913cb112f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ebf093-5ed7-4841-ada9-56fb64c01d36", "tag": "204879ec-a2ca-4355-9c8e-0ef34248f73b"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:48:24.496930 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-29f60fca-7457-405e-bac8-e5ce5b4baa66 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:24.497381 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-29f60fca-7457-405e-bac8-e5ce5b4baa66 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:24.498146 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-29f60fca-7457-405e-bac8-e5ce5b4baa66 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:24.498578 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-29f60fca-7457-405e-bac8-e5ce5b4baa66 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:24.501358 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-634092dc-a689-4b30-807c-0f206f122b01 req-c1a770d8-f2f2-433a-a998-12b913cb112f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:24.501954 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-634092dc-a689-4b30-807c-0f206f122b01 req-c1a770d8-f2f2-433a-a998-12b913cb112f service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:24.514572 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-634092dc-a689-4b30-807c-0f206f122b01 req-c1a770d8-f2f2-433a-a998-12b913cb112f service nova] Creating event network-changed:204879ec-a2ca-4355-9c8e-0ef34248f73b for instance 31ebf093-5ed7-4841-ada9-56fb64c01d36 on hv-cinder-85069 Jul 21 22:48:24.519831 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-634092dc-a689-4b30-807c-0f206f122b01 req-c1a770d8-f2f2-433a-a998-12b913cb112f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031632 Jul 21 22:48:24.520891 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 536/1022] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:48:24.526448 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-29f60fca-7457-405e-bac8-e5ce5b4baa66 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Going to try to terminate instance {{(pid=124497) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:48:24.626378 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-29f60fca-7457-405e-bac8-e5ce5b4baa66 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "DELETE /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 204 len: 0 microversion: 2.1 time: 0.139622 Jul 21 22:48:24.627260 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 487/1023] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:48:24 2022] DELETE /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:48:24.637331 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-4d4edeba-1fe6-411e-9b1c-6f3bc007029b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:24.638027 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-4d4edeba-1fe6-411e-9b1c-6f3bc007029b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:24.645378 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4d4edeba-1fe6-411e-9b1c-6f3bc007029b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:24.645378 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4d4edeba-1fe6-411e-9b1c-6f3bc007029b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:24.645860 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4d4edeba-1fe6-411e-9b1c-6f3bc007029b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:24.646355 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-4d4edeba-1fe6-411e-9b1c-6f3bc007029b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:24.796523 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.policy [None req-4d4edeba-1fe6-411e-9b1c-6f3bc007029b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:48:24.804916 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-4d4edeba-1fe6-411e-9b1c-6f3bc007029b tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1573 microversion: 2.1 time: 0.172228 Jul 21 22:48:24.805628 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 537/1024] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:48:24 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:48:25.823294 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-9813ac3e-ef94-4288-9ee8-b0b2809cf8af tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:25.823994 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-9813ac3e-ef94-4288-9ee8-b0b2809cf8af tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:25.830533 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9813ac3e-ef94-4288-9ee8-b0b2809cf8af tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:25.830983 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9813ac3e-ef94-4288-9ee8-b0b2809cf8af tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:25.831802 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9813ac3e-ef94-4288-9ee8-b0b2809cf8af tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:25.832249 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-9813ac3e-ef94-4288-9ee8-b0b2809cf8af tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:25.972953 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-9813ac3e-ef94-4288-9ee8-b0b2809cf8af tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:48:25.980664 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-9813ac3e-ef94-4288-9ee8-b0b2809cf8af tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1573 microversion: 2.1 time: 0.162531 Jul 21 22:48:25.981238 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 488/1025] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:48:25 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:48:26.549058 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [req-456608ee-57a3-409a-8eda-be046810c932 req-5b5f9c06-dbe5-42f2-b7c5-42ad22c6804d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ebf093-5ed7-4841-ada9-56fb64c01d36", "name": "network-vif-deleted", "tag": "204879ec-a2ca-4355-9c8e-0ef34248f73b"}]} {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:48:26.561508 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-456608ee-57a3-409a-8eda-be046810c932 req-5b5f9c06-dbe5-42f2-b7c5-42ad22c6804d service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:26.561961 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [req-456608ee-57a3-409a-8eda-be046810c932 req-5b5f9c06-dbe5-42f2-b7c5-42ad22c6804d service nova] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:26.575671 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.compute.server_external_events [req-456608ee-57a3-409a-8eda-be046810c932 req-5b5f9c06-dbe5-42f2-b7c5-42ad22c6804d service nova] Creating event network-vif-deleted:204879ec-a2ca-4355-9c8e-0ef34248f73b for instance 31ebf093-5ed7-4841-ada9-56fb64c01d36 on hv-cinder-85069 Jul 21 22:48:26.580385 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [req-456608ee-57a3-409a-8eda-be046810c932 req-5b5f9c06-dbe5-42f2-b7c5-42ad22c6804d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038056 Jul 21 22:48:26.581181 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 538/1026] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jul 21 22:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:48:26.997785 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-dbb8b959-10f4-48ba-a038-a1a4ff0bdbf6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:26.998334 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-dbb8b959-10f4-48ba-a038-a1a4ff0bdbf6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:27.004771 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dbb8b959-10f4-48ba-a038-a1a4ff0bdbf6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:27.005213 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dbb8b959-10f4-48ba-a038-a1a4ff0bdbf6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:27.005970 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dbb8b959-10f4-48ba-a038-a1a4ff0bdbf6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:27.006398 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dbb8b959-10f4-48ba-a038-a1a4ff0bdbf6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:27.041748 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dbb8b959-10f4-48ba-a038-a1a4ff0bdbf6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:27.042390 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-dbb8b959-10f4-48ba-a038-a1a4ff0bdbf6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:27.042843 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.objects.instance [None req-dbb8b959-10f4-48ba-a038-a1a4ff0bdbf6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lazy-loading 'fault' on Instance uuid 31ebf093-5ed7-4841-ada9-56fb64c01d36 {{(pid=124497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:48:27.086224 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.policy [None req-dbb8b959-10f4-48ba-a038-a1a4ff0bdbf6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a367906e74654507aaed8b885d525a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e273f945e45f0a6e1f3b45e4bc9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124497) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:48:27.095164 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-dbb8b959-10f4-48ba-a038-a1a4ff0bdbf6 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 200 len: 1227 microversion: 2.1 time: 0.101268 Jul 21 22:48:27.095933 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 489/1027] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:48:26 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 1227 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:48:28.112973 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a70fc7c6-34a2-44ea-8130-f49cd33f0867 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:28.113664 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-a70fc7c6-34a2-44ea-8130-f49cd33f0867 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: 31ebf093-5ed7-4841-ada9-56fb64c01d36] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:28.121597 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a70fc7c6-34a2-44ea-8130-f49cd33f0867 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:28.122045 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a70fc7c6-34a2-44ea-8130-f49cd33f0867 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:28.122803 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a70fc7c6-34a2-44ea-8130-f49cd33f0867 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:28.123270 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-a70fc7c6-34a2-44ea-8130-f49cd33f0867 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:28.138558 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-a70fc7c6-34a2-44ea-8130-f49cd33f0867 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] HTTP exception thrown: Instance 31ebf093-5ed7-4841-ada9-56fb64c01d36 could not be found. Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a70fc7c6-34a2-44ea-8130-f49cd33f0867 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Request method failure captured: Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 HTTP/1.1 Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dYbepniAuzydudqj9jHfd7hasx6r9Z3U-8l004a4-wK6Um_4WxYWFbgk8Te9BObBrOt0qWt2Tx5OQQpYeB0uNfsw_uv8kTWWNl_ozGedGRLvrG2V6Z_OeVgqtxPsnIfLKkFltKzmwfWauo-CMH8vo1AebQte2yt0UU6pbeI8Woup_o Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: e61e273f945e45f0a6e1f3b45e4bc9d2 Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:48:28.140183 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e61e273f945e45f0a6e1f3b45e4bc9d2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: e61e273f945e45f0a6e1f3b45e4bc9d2 Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-TestVolumeBootPattern-1281267028-project Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: a367906e74654507aaed8b885d525a0f Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-TestVolumeBootPattern-1281267028-project Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance 31ebf093-5ed7-4841-ada9-56fb64c01d36 could not be found. Jul 21 22:48:28.141845 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': '31ebf093-5ed7-4841-ada9-56fb64c01d36'} Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ebf093-5ed7-4841-ada9-56fb64c01d36 could not be found. Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:48:28.142790 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ebf093-5ed7-4841-ada9-56fb64c01d36 could not be found. Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ebf093-5ed7-4841-ada9-56fb64c01d36 could not be found. Jul 21 22:48:28.144437 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.145816 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-a70fc7c6-34a2-44ea-8130-f49cd33f0867 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Returning 404 to user: Instance 31ebf093-5ed7-4841-ada9-56fb64c01d36 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:48:28.145816 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-a70fc7c6-34a2-44ea-8130-f49cd33f0867 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36" status: 404 len: 111 microversion: 2.1 time: 0.032884 Jul 21 22:48:28.145816 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 539/1028] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:48:28 2022] GET /compute/v2.1/servers/31ebf093-5ed7-4841-ada9-56fb64c01d36 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:48:28.592492 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e3d90a85-9ae4-4da6-b519-ff32954c31f1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:28.593010 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.compute.api [None req-e3d90a85-9ae4-4da6-b519-ff32954c31f1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124497) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:28.599507 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e3d90a85-9ae4-4da6-b519-ff32954c31f1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:28.599957 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e3d90a85-9ae4-4da6-b519-ff32954c31f1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:28.600786 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e3d90a85-9ae4-4da6-b519-ff32954c31f1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:28.601320 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG oslo_concurrency.lockutils [None req-e3d90a85-9ae4-4da6-b519-ff32954c31f1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:28.614528 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.wsgi [None req-e3d90a85-9ae4-4da6-b519-ff32954c31f1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] HTTP exception thrown: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e3d90a85-9ae4-4da6-b519-ff32954c31f1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Request method failure captured: Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: request: DELETE /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 HTTP/1.1 Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept: application/json Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Accept-Encoding: identity Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Connection: close Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Length: 0 Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Content-Type: application/json Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Host: 10.222.0.58 Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Openstack-System-Scope: None Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: User-Agent: python-urllib3/1.26.9 Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Auth-Token: gAAAAABi2dYbepniAuzydudqj9jHfd7hasx6r9Z3U-8l004a4-wK6Um_4WxYWFbgk8Te9BObBrOt0qWt2Tx5OQQpYeB0uNfsw_uv8kTWWNl_ozGedGRLvrG2V6Z_OeVgqtxPsnIfLKkFltKzmwfWauo-CMH8vo1AebQte2yt0UU6pbeI8Woup_o Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Id: None Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Domain-Name: None Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Identity-Status: Confirmed Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Is-Admin-Project: True Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Id: default Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Domain-Name: Default Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Id: e61e273f945e45f0a6e1f3b45e4bc9d2 Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Project-Name: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Role: reader,member Jul 21 22:48:28.616235 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Roles: reader,member Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e61e273f945e45f0a6e1f3b45e4bc9d2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Id: e61e273f945e45f0a6e1f3b45e4bc9d2 Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User: tempest-TestVolumeBootPattern-1281267028-project Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Id: default Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Domain-Name: Default Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Id: a367906e74654507aaed8b885d525a0f Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: X-User-Name: tempest-TestVolumeBootPattern-1281267028-project Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: method: > Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: exception: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:48:28.618172 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: action_args: {'id': 'a280f0d7-0ea3-4377-898d-14c4b0d8a929'} Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:48:28.619099 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:48:28.620414 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.621718 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-e3d90a85-9ae4-4da6-b519-ff32954c31f1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Returning 404 to user: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. {{(pid=124497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:48:28.621718 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-e3d90a85-9ae4-4da6-b519-ff32954c31f1 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 404 len: 111 microversion: 2.1 time: 0.029143 Jul 21 22:48:28.621718 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 490/1029] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jul 21 22:48:28 2022] DELETE /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:48:28.626457 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cb59cbb5-f414-4ef0-b532-c5ec5cf737fa tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '>' {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:28.627101 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.compute.api [None req-cb59cbb5-f414-4ef0-b532-c5ec5cf737fa tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] [instance: a280f0d7-0ea3-4377-898d-14c4b0d8a929] Fetching instance by UUID {{(pid=124498) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:28.633634 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cb59cbb5-f414-4ef0-b532-c5ec5cf737fa tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:28.634102 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cb59cbb5-f414-4ef0-b532-c5ec5cf737fa tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:28.634895 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cb59cbb5-f414-4ef0-b532-c5ec5cf737fa tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:28.635420 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG oslo_concurrency.lockutils [None req-cb59cbb5-f414-4ef0-b532-c5ec5cf737fa tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Lock "ec464ddc-4674-4af0-a489-3c8a96608528" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:28.649427 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.wsgi [None req-cb59cbb5-f414-4ef0-b532-c5ec5cf737fa tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] HTTP exception thrown: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cb59cbb5-f414-4ef0-b532-c5ec5cf737fa tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Request method failure captured: Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: request: GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 HTTP/1.1 Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept: application/json Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Accept-Encoding: identity Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Connection: close Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Length: 0 Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Content-Type: application/json Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Host: 10.222.0.58 Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Openstack-System-Scope: None Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: User-Agent: python-urllib3/1.26.9 Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Auth-Token: gAAAAABi2dYbepniAuzydudqj9jHfd7hasx6r9Z3U-8l004a4-wK6Um_4WxYWFbgk8Te9BObBrOt0qWt2Tx5OQQpYeB0uNfsw_uv8kTWWNl_ozGedGRLvrG2V6Z_OeVgqtxPsnIfLKkFltKzmwfWauo-CMH8vo1AebQte2yt0UU6pbeI8Woup_o Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Id: None Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Domain-Name: None Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Identity-Status: Confirmed Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Is-Admin-Project: True Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Id: default Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Domain-Name: Default Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Id: e61e273f945e45f0a6e1f3b45e4bc9d2 Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Project-Name: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Role: reader,member Jul 21 22:48:28.650924 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Roles: reader,member Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e61e273f945e45f0a6e1f3b45e4bc9d2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e61e273f945e45f0a6e1f3b45e4bc9d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Id: e61e273f945e45f0a6e1f3b45e4bc9d2 Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281267028 Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User: tempest-TestVolumeBootPattern-1281267028-project Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Id: default Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Domain-Name: Default Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Id: a367906e74654507aaed8b885d525a0f Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: X-User-Name: tempest-TestVolumeBootPattern-1281267028-project Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: method: > Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: exception: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:48:28.652654 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: action_args: {'id': 'a280f0d7-0ea3-4377-898d-14c4b0d8a929'} Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: {{(pid=124498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:48:28.653517 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. Jul 21 22:48:28.654832 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: ERROR nova.api.openstack.wsgi Jul 21 22:48:28.656047 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: DEBUG nova.api.openstack.wsgi [None req-cb59cbb5-f414-4ef0-b532-c5ec5cf737fa tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Returning 404 to user: Instance a280f0d7-0ea3-4377-898d-14c4b0d8a929 could not be found. {{(pid=124498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:48:28.656047 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO nova.api.openstack.requestlog [None req-cb59cbb5-f414-4ef0-b532-c5ec5cf737fa tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929" status: 404 len: 111 microversion: 2.1 time: 0.029807 Jul 21 22:48:28.656047 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: [pid: 124498|app: 0|req: 540/1030] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jul 21 22:48:28 2022] GET /compute/v2.1/servers/a280f0d7-0ea3-4377-898d-14c4b0d8a929 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:48:29.950534 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: DEBUG nova.api.openstack.wsgi [None req-1544a2ad-222f-4ebe-a58b-874d4675b332 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] Calling method '.version_select at 0x7f47e65b1040>' {{(pid=124497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:29.973163 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO nova.api.openstack.requestlog [None req-1544a2ad-222f-4ebe-a58b-874d4675b332 tempest-TestVolumeBootPattern-1281267028 tempest-TestVolumeBootPattern-1281267028-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-67081037" status: 202 len: 0 microversion: 2.1 time: 0.026505 Jul 21 22:48:29.974016 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: [pid: 124497|app: 0|req: 491/1031] 10.222.0.58 () {58 vars in 1256 bytes} [Thu Jul 21 22:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-67081037 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:49:48.057455 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:49:48.058054 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Thu Jul 21 22:49:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:51:24.534263 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:51:24.534860 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Thu Jul 21 22:51:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:51:26.352087 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:51:26.352836 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Thu Jul 21 22:51:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:51:27.115006 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:51:27.115692 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Thu Jul 21 22:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:53:08.065445 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:53:08.066285 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Thu Jul 21 22:53:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:53:27.272991 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:53:27.273637 dv-cinder-850698-1-iscsi devstack@n-api.service[124497]: Thu Jul 21 22:53:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:53:29.585091 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:53:29.585668 dv-cinder-850698-1-iscsi devstack@n-api.service[124498]: Thu Jul 21 22:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!